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Abstract 



This technical report presents results from a cross-validation study designed to identify optimal 
cut scores when using easyCBM® reading tests in Oregon. The cross-validation study analyzes 
data from the 2009-2010 academic year for easyCBM reading measures. A sample of 
approximately 2,000 students per grade, randomly split into two groups of roughly the same size, 
was used for this study. Students state test performance classification (passing/not passing) on 
the Oregon Assessment of Knowledge and Skills (OAKS) was used as the criterion. Optimal cut 
scores were identified for each of the randomly split groups with a receiver operating 
characteristic curve (ROC) analysis. Results indicated reasonably stable cut scores between 
groups. Further, the overall area under the ROC curve (AUC) was not statistically different 
between groups for any measurement occasion at any grade, providing strong evidence for the 
validity of identified cut scores as optimal to predict student performance classification on the 
Oregon state large-scale assessment. 
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A Cross-validation of easyCBM Reading Cut Scores in Oregon: 2009-2010 

In this technical report, we present findings from a cross-validation study examining the 
diagnostic efficiency of easyCBM® reading tests. Data for these tests were analyzed for grades 
3-8, and came from the 2009-2010 academic year. Park, Anderson, Irvin, Alonzo, and Tindal 
(201 1) used a large sample in Oregon to establish optimal cut scores for predicting performance 
classification (not passing/passing) on the reading portion of the Oregon Assessment of 
Knowledge and Skills (OAKS), the state test used in Oregon. We extend their study by randomly 
splitting the same sample into two groups and examining the stability of the optimal cut scores 
for each easyCBM® reading measure across the randomly selected groups. The relative stability 
of the cut points provides further evidence to support the specified cut point for predicting state 
test classification in Oregon. 

Theoretical Framework 

The online easyCBM® progress monitoring assessment system was launched in 
September 2006 as part of a Model Demonstration Center on Progress Monitoring funded by the 
Office of Special Education Programs (OSEP). Since 2006, up to 17 forms for each reading 
measure have been developed for grades K-8. These reading measures accompany the 33 test 
forms available at each of grades K-8 for mathematics, together making up the easyCBM® online 
assessment system. 

The easyCBM® reading measures were developed specifically for use within a response 
to intervention (RTI) framework. Within RTI, students are administered benchmark screening 
assessments periodically throughout the year (e.g., fall, winter, and spring). From these 
benchmark assessments, students are classified into tiers of “academic risk,” typically based on 
normative cut scores. For example, a district using easyCBM® may administer the reading 
assessments in the fall for benchmark screening purposes. Based on student results on these 
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screening tests, and on a set of performance-associated normative risk ratings that the district 
identifies for each measure, students are classified into one of two tiers of risk (Tier 1: not at-risk 
or Tier 2: at risk). Students identified as at-risk on one or more easyCBM® reading assessments 
are then provided with a targeted academic intervention, and their progress is monitored with 
frequent easyCBM® administrations. The progress-monitoring probes are administered until the 
student (a) has responded to the intervention and is placed back in Tier 1, or (b) the subsequent 
benchmarking occasion, at which point tier placement is re-evaluated. 

Although many districts operate under a normative evaluation of student achievement 
when assigning tier placement, a criterion-referenced view may provide additional useful 
information. For example, a district may know that students scoring an 8 or below on a particular 
screener are below the 20 th percentile. However, from a criterion-referenced view, the district 
may also take into account that students scoring an 1 1 or below are not likely to pass the state 
test. A score of 1 1 may be closer to the 30 th percentile of normative achievement. The educators 
within the district can then determine what the most optimal cut-point would be for their district 
given the resources available, weighing both the normative and criterion-referenced 
interpretations of student achievement. 

The easyCBM® system has three designated benchmark screening assessments for 
reading, administered during the fall, winter, and spring for fluency and comprehension, and 
during fall and spring for vocabulary. The remaining reading assessment forms for a given 
measure and at a given grade are designated for progress-monitoring between the seasonal 
benchmark assessments. Although ostensibly low-stakes in nature, perhaps the most critical 
assessment occasion for easyCBM® reading assessments is the fall benchmark screener. As in 
the example above, the results from the fall benchmarks are used to initially classify students into 
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RTI tiers, from which two types of errors can occur: false positives and false negatives. A false 
positive occurs when a student is incorrectly identified as being at-risk, while a false negative 
occurs when a student is incorrectly identified as being not at risk. From an instructional 
standpoint and within the RTI model, false negatives are of far greater concern than false 
positives. Students who are not identified as at-risk when they should be are provided only 
typical grade-level instruction and are not tested again until the next benchmark screening in the 
winter. In other words, when a false negative occurs, students may be excluded from potentially 
valuable reading interventions for months, unless their teacher or a separate measure deems them 
at-risk. In contrast, false positives result in providing targeted interventions to students who are 
not necessarily in need. In the case of a false positive, additional interventions given to students 
not in need can be a drain on instructional resources. 

Although false positives may drain limited resources, they are not as great a concern as 
false negatives because students receiving unneeded additional support are also administered 
additional progress-monitoring measures. Thus, students who are not in need of the additional 
support will likely be correctly reclassified as being not at-risk based on results from additional 
progress monitoring assessments, whereas students misclassified by false negatives may spend 
much of the school year not receiving instructional interventions they need to improve their 
reading. Given the importance of the instructional decisions made based on student performance 
on the easyCBM® benchmark reading measures and the inherent complexity around identifying a 
student as being at-risk, it is important to scrutinize potential easyCBM® cut scores used for 
classifying students. 

We examine raw score cut points on easyCBM® benchmarks with a criterion-referenced 
evaluation, determining how well each score predicts performance-level classification on the 
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reading portion of the OAKS. Park et al. (201 1) established optimal raw score cut points, and we 
extend this work by conducting a cross-validation study to explore the stability of optimal cut 
scores when the sample is randomly split into two similar groups. Therefore, we examine and 
report only the diagnostic efficiency information obtained from the receiver operating 
characteristics (ROC) curve analysis (including the ROC curve figure, area under the curve 
statistics, and the sensitivity and specificity of each cut score), and not other classification 
statistics such as the positive and negative predictive power, or overall correct classification rate. 
Readers are referred to Park et al.’s (201 1) technical report for this information. 

Methods 

Setting and Subjects 

Three districts participated in this study. The demographics and number of students in the 
full sample are reported by grade level in Table 1 and by district in Table 2. Two of the three 
participating districts have implemented a district-wide response to intervention (RTI) program. 
As part of this program, all students, including English language learners and/or students with 
learning disabilities, are assessed using seasonal easyCBM® benchmark screeners. All students 
in these two districts who were present on the day of testing were included in the study. The third 
district administered the easyCBM® benchmark assessments to a subset of classes selected to 
match overall district demographics. 

Measures 

In this section, we begin by first describing the easyCBM® reading benchmark screening 
assessments under investigation. We then describe the state test, used as the criterion to 
determine students “true classification”: the OAKS. 

For students in grades two through eight, three types of reading measures are available 
through easyCBM®: fluency, comprehension, and vocabulary. The fluency and comprehension 
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measures are administered in the fall, winter, and spring, while the vocabulary measure is 
administered only in the fall and spring. Both the comprehension and vocabulary easyCBM® 
measures are computer-based, although teachers have access to printable versions of the tests so 
they can be administered via paper-pencil. Fluency measures are designed for individual 
administration, with scores recorded on the computer after student performance has been 
assessed. All easyCBM® test forms of a specific type and within a grade-level were designed to 
be of equivalent difficulty. However, no attempt was made to control the difficulty of the 
measures across different test types (i.e., the comprehension tests are not designed to be of 
equivalent difficulty to the fluency or vocabulary tests within a given grade level). 

Fluency. There are two types of fluency measures available through easyCBM®: word 
reading fluency (WRF) and passage reading fluency (PRF). The WRF measures are available in 
grades K-3, while the PRF measures are available in grades 1-8. For the current study, we 
analyze easyCBM® PRF results only in the grades where the OAKS was administered (3-8). 
Although some data were available on the WRF measures in grade 3, this measure was not 
included in the current study. By grade 3 students have typically “graduated” from the WRF 
measures to the PRF measures, and very few teachers chose to use WRF for benchmark 
screening in the study samples. 

The PRF measures consist of an original work of fictional narrative varying in length 
from 250 to 380 words, depending on the grade-level. Students are administered the measures 
individually by trained assessors. The assessor begins by reading a standardized set of directions 
and presenting the student with the passage on a single page. The assessor provides one-minute 
of reading time and scores the number of correctly read words per minute. Words students fail to 
read or read incorrectly are counted as errors, while self-corrections are scored as correct. A 
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complete description of the development of the PRF measures can be found in Alonzo, Park, and 
Tindal (2008), Alonzo and Tindal (2008), and Alonzo and Tindal (2007). 

Comprehension. Students’ comprehension skills are assessed with the easyCBM® 
multiple-choice reading comprehension (MCRC) measures. MCRC measures for grades 3-8 
contain 20 items assessing students’ comprehension of a 1,500 word fictional narrative. The 
comprehension items are designed to target students’ literal (7 items), inferential (7 items), and 
evaluative (6 items) comprehension. Literal items ask the student to identify a specific event 
from the text. Inferential questions require students to infer unwritten meaning from the text. For 
example, a story may describe how a character feels, but not explicitly describe the character’s 
feelings. A typical inferential question might then explicitly ask how the character felt. 

Evaluative questions ask the reader to evaluate the situation and make a judgment. For example, 
an item may ask what a character in the story would likely do if he or she were in the situation 
described in the story at another time. Students are allowed to read back through the text as they 
are answering the items. Each item consists of a question stem followed by three possible answer 
choices: one correct, one intended as a near-distractor, and one intended as a far-distractor. Each 
item is worth one point for a total possible raw score of 20. Additional description of the 
development of the MCRC measures can be found in Park, Alonzo, and Tindal (201 1) and 
Alonzo, Liu, and Tindal (2007). 

Vocabulary. The vocabulary (VOC) measures available through easyCBM® contain 25 
multiple-choice items. The stem of each item consists of a single vocabulary word targeted at the 
students’ grade level. Various word- lists were used during development to determine appropriate 
words (e.g., Fry, EDL Core Vocabulary, etc.). Each item contains three answer options 
consisting of a correct response and two relevant distractors. The correct response was the 
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second most-common synonym of the word as indicated in the dictionary. Complete description 
of the development of the VOC measures can be found in Alonzo and Tindal (2004). 

Oregon Assessment of Knowledge and Skills (OAKS) 

The OAKS is a 50-item fixed-length computer-adaptive test. Students are allowed to take 
the test anywhere from 1-3 times during the school year, with their highest score retained for 
accountability purposes. The OAKS reading test has six score reporting categories: (a) 
vocabulary, (b) read to perform a task, (c) demonstrate a general understanding, (d) develop an 
interpretation, (e) examine content and structure of informative text, and (f) examine content and 
structure of literary text. The percentages of each item type are differentially weighted across 
grades (for specific weighting, see ODE, 2011). The items targeting develop an interpretation 
are closely related to what easyCBM® refers to as inferential type questions on MCRC tests, 
while the items targeting examine content and structure of literary text are closely related to 
easyCBM® evaluative type questions on the MCRC. All items have four response options with 
one correct response and three distracters. Students’ scores are reported in Rasch units, a 
continuous scale ranging from 0 to infinity. The Rasch unit scale accounts for students’ response 
to items relative to the item difficulty. According to the Oregon Department of Education, most 
scores range from 150 - 300 (Oregon Department of Education, 2010). The meeting scores for 
the OAKS reading test in grades 3-8 for 2010 were 204, 211, 218, 222, 227, and 231 
respectively. 

Data Analyses 

To evaluate the stability of the optimal cut scores selected for each easyCBM® measure, 
we randomly split the sample into two similar groups. After each group was selected, we 
followed a two-stage process. First, we evaluated the groups to ensure that the random group 
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selection resulted in two demographically comparable samples. Second, we conducted receiver 
operating characteristic curve (ROC) analyses with each group for each measure at each time- 
point. The results of the ROC analyses were then used to select an optimal cut-score for each 
group. The stability of the optimal cut-scores across the randomly selected groups was then 
compared. 

Random Split-File. Groups were randomly split into two groups using the random 
sample selection function in SPSS 18.0, by which each case is randomly assigned a value based 
on the specified probability parameter of 0.5, giving each student case an equal probability of 
being assigned to either group. We then conducted a series of /-tests with student subgroups to 
determine whether the students from a particular subgroup differed significantly between the 
randomly selected groups. In addition, we conducted /-tests with each measure used in the study 
to determine if students’ performance differed significantly between the two groups. For these t- 
tests, we analyzed comparability of the samples based on ten student subgroup categories: seven 
for ethnicity (American Indian/ Alaskan Native, Asian/Pacific Islander, Black, Hispanic, White, 
Multiethnic, and Decline to Identify) and one for each of Special Education; English Language 
Learner; and economically disadvantaged students (determined by free or reduced priced lunch 
eligibility). 

ROC Analyses. When /-test results indicated that the randomly selected groups were 
comparable, we conducted a ROC analysis for each measure and grade for each randomly 
selected half of the sample. We examined the overall AUC for comparability between the 
groups, with respect to a 95% confidence interval. Overlapping confidence intervals indicated a 
non-significant difference between the randomly selected groups. We then evaluated the 
sensitivity and specificity of each cut score and chose an optimal cut score for each group, using 
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the same approach described in the study by Anderson, Alonzo, and Tindal (2010). 

These decision rules applied a slightly modified version of the decision rules outlined by 
Silberglitt and Hintze (2005). Silberglitt and Hintze aimed to maximize both sensitivity and 
specificity, but placed an increased emphasis on sensitivity. When determining an optimal cut 
score, they suggest the researcher: 

(a) determine the cut score(s) that yield at least 0.7 for sensitivity and specificity; (b) if 
possible, increase sensitivity from this point, continuing upward while still maintaining 
specificity of 0.7, stopping if sensitivity exceeds 0.8; (c) if sensitivity exceeds 0.8 and 
specificity can still be increased, continue to maximize specificity (while maintaining 
sensitivity of 0.8); and (d) if both sensitivity and specificity exceed 0.8, repeat steps 2 and 
3, using 0.9 as the next cutoff (p. 316). 

We felt that if both sensitivity and specificity were above 0.8, that cut score would be the best 
option. However, if no cut score resulted in both sensitivity and specificity being above 0.8, 
sensitivity was maximized while keeping specificity above 0.7, even if a different cut score 
would have resulted in both statistics being close to 0.8. These modified rules placed a further 
emphasis on sensitivity, which we felt was warranted given the importance of reducing false 
negatives in an RTI model. 

Results 

We present the results of this cross-validation study in two sections: (a) sample 
comparisons of demographic characteristics between the two randomly split groups, and (b) 
optimal cut scores and ROC analyses for both groups. 
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Section One: Sample Demographic Comparisons 

Sample characteristics were compared based on the proportion of each student subgroup 
and the descriptive statistics of each measure. The /-test results indicated that across all grades, 
the two groups did not differ significantly based on demographic characteristics with two 
exceptions: the proportion of students who declined to identify their ethnicity in grade 4, /(3640) 
= -2.16, p = .031 and the proportion of students receiving free or reduced priced lunch in grade 5, 
/(2140) = 1 .98. p = .047. Although /-tests indicated statistically significant differences in these 
two instances, examination of the descriptive statistics related to each group indicated that the 
differences between the two groups in the two aforementioned categories were minimal. Thus, 
we concluded that student demographic characteristics across the two randomly split groups 
were sufficiently similar for cross-validation analysis of identified optimal cut scores between 
the groups. The results of the comparison of sample demographic characteristics between the two 
groups are presented, by grade, in Appendix A. 

Section Two: ROC Analyses and Optimal Cut Scores 

ROC analysis computes sensitivity and specificity statistics for all possible cut scores in 
half-point increments. When selecting an optimal meeting score, the next highest whole number 
of a chosen cut score is reported, serving as the basis for student classification. For example, 
given a cut score value of 9.5 on a benchmark vocabulary measure, students who score 9 or 
below would be classified as at-risk of failing to meet the state standard, whereas students who 
score 10 or above would be classified as not at-risk. In this case, 10 would be reported as an 
optimal meeting score for this measure. The chosen meeting cut scores for each measure yielded 
the most optimal sensitivity and specificity statistics based on the decision rules outlined above 



for the two groups. 
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Grade 3 results. For students in Grade 3, the optimal meeting score on the easyCBM® 
fall PRF benchmark test was 61 correct words per minute (CWPM) for the first group and 62 
CWPM for the second group. On the fall MCRC benchmark test, the optimal meeting scores 
were 10 and 9 for the first and the second group, respectively. On the fall VOC benchmark test, 
the optimal meeting scores were 13 and 14 for the first and the second group, respectively. The 
optimal meeting score on the easyCBM® winter PRF benchmark test was 89 CWPM for the first 
group and 90 for the second group. On the winter MCRC benchmark test, the optimal meeting 
scores were 10 for both groups. The optimal meeting score on the easyCBM® spring PRF 
benchmark test was 93 CWPM for the first group and 92 CWPM for the second group. On the 
spring MCRC benchmark test, the optimal meeting scores were 13 for both groups. On the 
spring VOC benchmark test, the optimal meeting scores were 21 for both groups. 

Grade 4 results. For students in Grade 4, the optimal meeting score on the easyCBM® 
fall PRF benchmark test was 95 CWPM for the first group and 96 CWPM for the second group. 
On the fall MCRC benchmark test, the optimal meeting scores were 10 and 1 1 for the first and 
the second group, respectively. On the fall VOC benchmark test, the optimal meeting scores 
were 13 and 14 for the first and the second group, respectively. The optimal meeting score on the 
easyCBM® winter PRF benchmark test was 119 CWPM for the first group and 121 CWPM for 
the second group. On the winter MCRC benchmark test, the optimal meeting scores were 13 for 
both groups. The optimal meeting scores on the easyCBM® spring PRF benchmark test were 123 
CWPM for both. On the spring MCRC benchmark test, the optimal meeting scores were 12 and 
13 for the first and the second group, respectively. On the spring VOC benchmark test, the 
optimal meeting scores were 18 for both groups. 
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Grade 5 results. For students in Grade 5, the optimal meeting score on the easyCBM® 
fall PRF benchmark test was 137 CWPM for the first group and 138 CWPM for the second 
group. On the fall MCRC benchmark test, the optimal meeting scores were 13 for both groups. 
On the fall VOC benchmark test, the optimal meeting scores were 17 for both groups. The 
optimal meeting score on the easyCBM® winter PRF benchmark test was 141 CWPM for the 
first group and 143 CWPM for the second group. On the winter MCRC benchmark test, the 
optimal meeting scores were 15 and 16 for the first and the second group, respectively. The 
optimal meeting score on the easyCBM® spring PRF benchmark test was 159 CWPM for the 
first group and 162 CWPM for the second group. On the spring MCRC benchmark test, the 
optimal meeting scores were 15 for both groups. On the spring VOC benchmark test, the optimal 
meeting scores were 20 for both groups. 

Grade 6 results. For students in Grade 6, the optimal meeting score on the easyCBM® 
fall PRF benchmark test was 135 CWPM for the first group and 134 CWPM for the second 
group. On the fall MCRC benchmark test, the optimal meeting scores were 14 and 15 for the first 
and the second group, respectively. On the fall VOC benchmark test, the optimal meeting scores 
were 14 for both groups. The optimal meeting score on the easyCBM® winter PRF benchmark 
test was 147 CWPM for the first group and 151 CWPM for the second group. On the winter 
MCRC benchmark test, the optimal meeting scores were 14 and 13 for the first and the second 
group, respectively. The optimal meeting score on the easyCBM® spring PRF benchmark test 
was 152 CWPM for the first group and 156 CWPM for the second group. On the spring MCRC 
benchmark test, the optimal meeting scores were 15 for both groups. On the spring VOC 
benchmark test, the optimal meeting scores were 15 for both groups. 
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Grade 7 results. For students in Grade 7, the optimal meeting score on the easyCBM® 
fall PRF benchmark test was 145 for the first group and 143 for the second group. On the fall 
MCRC benchmark test, the optimal meeting scores were 13 and 14 for the first and the second 
group, respectively. On the fall VOC benchmark test, the optimal meeting scores were 13 for 
both groups. The optimal meeting scores on the easyCBM® winter PRF benchmark test were 160 
CWPM for both groups. On the winter MCRC benchmark test, the optimal meeting scores were 
15 for both groups. The optimal meeting score on the easyCBM® spring PRF benchmark test 
was 153 CWPM for the first group and 152 CWPM for the second group. On the spring MCRC 
benchmark test, the optimal meeting scores were 12 for both groups. On the spring VOC 
benchmark test, the optimal meeting scores were 15 for both groups. 

Grade 8 results. For students in Grade 8, the optimal meeting scores on the easyCBM® 
fall PRF benchmark test were 166 CWPM for both groups. On the fall MCRC benchmark test, 
the optimal meeting scores were 15 for both groups. On the fall VOC benchmark test, the 
optimal meeting scores were 14 for both groups. The optimal meeting score on the easyCBM® 
winter PRF benchmark test was 156 CWPM for the first group and 159 CWPM for the second 
group. On the winter MCRC benchmark test, the optimal meeting scores were 13 for both 
groups. The optimal meeting scores on the easyCBM® spring PRF benchmark test were 160 
CWPM for both groups. On the spring MCRC benchmark test, the optimal meeting scores were 
14 and 13 for the first and the second group, respectively. On the spring VOC benchmark test, 
the optimal meeting scores were 16 for both groups. 

The sensitivity and specificity statistics for all possible cut scores and the results of ROC 
analyses for the three reading easyCBM® measures are presented in the order of PRF, MCRC, 
and VOC, by grade, for both groups in Appendix B. The results are presented in the order of (a) 
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case processing summary, (b) area under curve statistics, (c) ROC curve figures, and (d) 
sensitivity and specificity statistics for each cut score. The determined optimal cut scores for 
each group are displayed in bold-faced font in the sensitivity and specificity tables. 

Discussion 

Overall, identified optimal cut scores appear quite stable across the two randomly split 
groups. Specifically, the average difference in cut scores for the easyCBM® PRF measure 
between groups was 1.50 CWPM for 18 grade-level and measurement occasion comparisons (6 
grade levels, 3 measurement occasions at each grade). The average difference between cut scores 
for the MCRC and VOC measures was 0.44 and 0.17 for 18 and 12 grade-level and measurement 
occasion comparisons, respectively. Additionally, 95% confidence intervals for AUC statistics 
overlapped between groups for each measure type at all measurement occasions, indicating that 
observed differences in identified optimal cut scores between the two groups are non-significant. 
The consistency of optimal cut scores across measurement occasions for the two groups and the 
non-significant differences in AUC statistics at all measurement occasion and grades provide 
strong evidence for the validity of the cut scores derived. 

Although identified optimal cut scores appear stable across the two groups used in the 
study, caution is warranted when extrapolating the actual values of identified cut scores. The 
identified cut scores were chosen using the Oregon state test as the criterion; a different criterion 
may well produce different optimal cut-scores. Performance standards vary from state to state, 
and we would expect the identified cut scores to differ based on the state test used (for example, 
see Anderson, Park, Irvin, Alonzo, & Tindal, 2011). However, given a common criterion, the 
results of this study indicate that the optimal cut-score is quite stable. Caution is also warranted 
when considering the identified optimal cut scores used in this study given that the sample, 
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although large, included only three districts within the state of Oregon. Identified optimal cut- 
scores could serve as a guide to districts within Oregon, but should not serve as a substitute for 
careful state- and district-level judgment of easyCBM® cut score identification and evaluation 
within high-stakes accountability systems. 
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Table 1 

Demographics - Full Sample 



% Ethnicity 



Grade 


n 


% ELL 


% FRL 


% SPED 


% Female 


Amer 

Ind 


Asian/Pac 

Islander 


Black 


Hispanic 


White 


Multi 


Decline/ 

Missing 


3 


2086 


9.9 


53.6 


15.2 


48.1 


1.1 


5.1 


2.0 


23.0 


63.9 


2.2 


2.5 


4 


2026 


8.1 


53.7 


15.9 


47.4 


1.5 


5.3 


2.3 


23.4 


61.9 


3.3 


2.2 


5 


2142 


7.3 


51.8 


16.2 


47.8 


1.6 


5.7 


2.6 


22.0 


62.7 


2.7 


2.6 


6 


1990 


6.1 


43.8 


16.6 


49.0 


1.6 


4.6 


2.2 


6.9 


65.5 


4.0 


15.2 


7 


1916 


5.1 


47.3 


14.5 


49.8 


1.0 


5.5 


2.2 


21.0 


65.0 


3.5 


1.7 


8 


2055 


5.0 


46.7 


13.6 


47.7 


1.1 


4.6 


2.5 


22.1 


63.2 


3.1 


3.4 
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Table 2 

Demographics by District 



% Ethnicity 















Amer 


Asian/Pac 










Decline/ 


Grade 


n 


% ELL 


% ERL 


% SPED 


% Female 


Ind 


Islander 


Black 


Hispanic 


White 


Multi 


Missing 


District 1 


3 


1311 


4.7 


44.3 


15.9 


47.2 


1.7 


4.7 


2.4 


10.1 


73.2 


3.1 


4.8 


4 


1299 


4.4 


44.7 


17.4 


49.3 


1.9 


4.4 


2.8 


11.6 


70.1 


4.6 


4.4 


5 


1357 


3.7 


43.6 


17.4 


48.3 


1.8 


5.2 


2.6 


9.9 


71.2 


3.8 


5.5 


6 


1329 


4.0 


38.1 


18.7 


46.9 


2.6 


4.8 


2.6 


9.2 


67.3 


2.9 


1.7 


7 


1262 


3.0 


39.8 


15.5 


52.5 


1.5 


5.9 


2.8 


10.5 


70.6 


4.6 


1.7 


8 


1298 


2.3 


38.6 


13.7 


49.8 


.9 


4.7 


2.8 


10.9 


69.0 


4.9 


6.8 


District 2 


3 


870 


1.1 


61.8 


17.0 


49.0 


1.7 


2.0 


1.4 


19.8 


67.0 


2.2 


6.0 


4 


818 


- 


63.3 


19.8 


42.5 


2.1 


1.8 


1.6 


17.0 


66.5 


4.0 


6.9 


5 


876 


1.4 


60.3 


19.3 


48.2 


2.4 


2.1 


1.6 


16.7 


67.9 


4.1 


5.3 


6 


846 


1.5 


58.0 


16.9 


50.4 


2.6 


1.4 


1.7 


14.9 


70.7 


3.5 


5.2 


7 


737 


3.0 


58.3 


15.9 


47.5 


2.2 


1.6 


1.1 


18.6 


67.8 


2.8 


5.9 


8 


843 


1.9 


55.5 


15.8 


47.9 


1.5 


1.4 


2.3 


16.3 


70.6 


3.0 


5.0 


District 3 


3 


1707 


18.7 


- 


13.1 


48.4 


0.0 


7.0 


1.9 


33.7 


52.0 


1.5 


4.0 


4 


1623 


15.2 


- 


12.0 


48.3 


0.0 


7.7 


2.2 


34.6 


49.7 


1.7 


4.2 


5 


1618 


13.8 


- 


13.4 


47.0 


0.0 


8.0 


3.1 


33.7 


49.5 


.9 


4.8 


6 


1613 


11.9 


- 


13.0 


48.5 


0.7 


7.1 


2.4 


34.0 


50.7 


1.1 


4.1 


7 


1643 


9.3 


- 


12.4 


48.5 


0.9 


6.8 


2.3 


29.1 


55.3 


1.3 


4.4 


8 


1608 


9.1 


- 


13.2 


45.9 


1.0 


6.3 


2.4 


33.3 


51.7 


1.6 


3.7 



Note. Numbers reflect full sample separated by District. However, during analyses students were excluded listwise and the actual 
demographics of students included varies by analysis. All values thus more accurately represent the Districts and sample, but not 
necessarily the analyses. Statistics are intended to provide only a general indication of the students included in the analyses. 

ELL - English Language Learner, ERL - Lree or reduced lunch eligible, SPED - Student receives special education services 
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Appendix A: Results of the Random Sample Split 



Grade 3 



Crossvalidation 







Frequency 


Percent 


Valid Percent Cumulative Percent 


Valid 


Group 1 


1944 


50.0 




50.0 


50.0 




Group 2 


1944 


50.0 




50.0 


100.0 




Total 


3888 


100.0 




100.0 




EthnicCd 












Valid 


Cumulative 


Crossvalidation 




Frequency 


Percent 


Percent 


Percent 


Group 1 


Valid 


American 

Indian/Alaskan Native 


24 


1.2 


1.3 


1.3 






Asian/Pacific Islander 


101 


5.2 


5.3 


6.6 






Black 


44 


2.3 


2.3 


8.9 






Hispanic 


442 


22.7 


23.3 


32.2 






White 


1199 


61.7 


63.1 


95.3 






Multi-Ethnic 


44 


2.3 


2.3 


97.6 






Decline/Missing 


45 


2.3 


2.4 


100.0 






Total 


1899 


97.7 


100.0 






Missing 


System 


45 


2.3 








Total 




1944 


100.0 






Group 2 


Valid 


American 

Indian/Alaskan Native 


19 


1.0 


1.0 


1.0 






Asian/Pacific Islander 


92 


4.7 


4.9 


5.9 






Black 


33 


1.7 


1.7 


7.6 






Hispanic 


430 


22.1 


22.8 


30.4 






White 


1224 


63.0 


64.8 


95.1 






Multi-Ethnic 


41 


2.1 


2.2 


97.3 






Decline/Missing 


51 


2.6 


2.7 


100.0 






Total 


1890 


97.2 


100.0 






Missing 


System 


54 


2.8 








Total 




1944 


100.0 
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SPED 















Cumulative 


Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


No 


1618 


83.2 


85.0 


85.0 






Yes 


285 


14.7 


15.0 


100.0 






Total 


1903 


97.9 


100.0 






Missing 


System 


41 


2.1 








Total 




1944 


100.0 






Group 2 


Valid 


No 


1615 


83.1 


84.6 


84.6 






Yes 


295 


15.2 


15.4 


100.0 






Total 


1910 


98.3 


100.0 






Missing 


System 


34 


1.7 








Total 




1944 


100.0 







Female 

Cumulative 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


Male 


998 


51.3 


51.4 


51.4 






Female 


945 


48.6 


48.6 


100.0 






Total 


1943 


99.9 


100.0 






Missing 


System 


1 


.1 








Total 




1944 


100.0 






Group 2 


Valid 


Male 


1017 


52.3 


52.3 


52.3 






Female 


926 


47.6 


47.7 


100.0 






Total 


1943 


99.9 


100.0 






Missing 


System 


1 


.1 








Total 




1944 


100.0 
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ELL 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Cumulative 

Percent 


Group 1 


Valid 


No 


1744 


89.7 


89.7 


89.7 






Yes 


200 


10.3 


10.3 


100.0 






Total 


1944 


100.0 


100.0 




Group 2 


Valid 


No 


1756 


90.3 


90.3 


90.3 






Yes 


188 


9.7 


9.7 


100.0 






Total 


1944 


100.0 


100.0 





EeonDsvntg 



Crossvalidation 




Frequency Percent Valid Percent 


Cumulative 

Percent 


Group 1 Valid 


No 


482 


24.8 


46.2 


46.2 




Yes 


561 


28.9 


53.8 


100.0 




Total 


1043 


53.7 


100.0 




Missing 


999 


44 


2.3 








System 


857 


44.1 








Total 


901 


46.3 






Total 




1944 


100.0 






Group 2 Valid 


No 


485 


24.9 


46.5 


46.5 




Yes 


558 


28.7 


53.5 


100.0 




Total 


1043 


53.7 


100.0 




Missing 


999 


51 


2.6 








System 


850 


43.7 








Total 


901 


46.3 






Total 




1944 


100.0 
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OAKS_Perf 





Cumulative 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


.00 


217 


11.2 


11.8 


11.8 






1.00 


1620 


83.3 


88.2 


100.0 






Total 


1837 


94.5 


100.0 






Missing 


System 


107 


5.5 








Total 




1944 


100.0 






Group 2 


Valid 


.00 


223 


11.5 


12.2 


12.2 






1.00 


1612 


82.9 


87.8 


100.0 






Total 


1835 


94.4 


100.0 






Missing 


System 


109 


5.6 








Total 




1944 


100.0 
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Descriptive Statistics 



Crossvalidation 


N 


Minimum 


Maximum 


Mean 


Std. Deviation 


Group 1 


OAKSRdgTot 


1837 


177 


255 


214.33 


10.710 




OAKS_Perf 


1837 


.00 


1.00 


.8819 


.32285 




Fall09PRF 


1110 


0 


219 


85.50 


39.554 




Fall09MCRC 


1156 


0 


19 


10.46 


4.146 




Fall09Voc 


1030 


0 


25 


16.66 


5.140 




WintlOPRF 


1148 


0 


308 


117.57 


45.521 




WintlOMCRC 


1231 


0 


18 


10.19 


3.500 




SprlOPRF 


1108 


3 


255 


118.18 


43.244 




SprlOMCRC 


1198 


0 


20 


13.55 


4.360 




SprlOVoc 


1082 


0 


25 


21.54 


4.171 




Valid N (listwise) 


941 










Group 2 


OAKSRdgTot 


1835 


166 


256 


214.64 


10.885 




OAKS_Perf 


1835 


.00 


1.00 


.8785 


.32683 




Fall09PRF 


1099 


0 


244 


86.08 


40.958 




Fall09MCRC 


1157 


0 


20 


10.42 


4.142 




Fall09Voc 


1030 


0 


25 


16.88 


5.418 




WintlOPRF 


1148 


6 


268 


116.45 


46.421 




WintlOMCRC 


1228 


0 


17 


10.13 


3.614 




SprlOPRF 


1108 


8 


266 


116.90 


44.058 




SprlOMCRC 


1174 


0 


20 


13.49 


4.404 




SprlOVoc 


1060 


0 


25 


21.55 


4.155 




Valid N (listwise) 


936 
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Independent Samples Test 

Levene's Test for Equality of 
Variances 



F Sig. t df 

2.258 .133 .751 3787 

.751 3743.401 



AsianPacIslnder Equal variances 
assumed 

Equal variances not 

assumed 

Black Equal variances 

assumed 

Equal variances not 

assumed 

Hispanic Equal variances 

assumed 

Equal variances not 
assumed 

White Equal variances 

assumed 

Equal variances not 
assumed 

Multiethnic Equal variances 

assumed 

Equal variances not 
assumed 

Decline Equal variances 

assumed 

Equal variances not 

assumed 

SPED Equal variances .649 .420 -.403 3811 

assumed 

Equal variances not -.403 3810.693 

assumed 



1.593 .207 .631 3787 

.631 3781.783 

6.214 3M3 1.245 3787 

1.246 3721.212 

.587 A4 4 383 3787 

.383 3786.960 

4.322 3)38 -1.040 3787 

-1.040 3786.903 
.377 339 307 3787 

.307 3784.156 
1.658 T98 T644 3787 

-.644 3769.605 



Amerind AkNative Equal variances 
assumed 

Equal variances not 
assumed 



t-test for Equality of Means 



Sig. (2- 



Std. Error 



95% Confidence Interval of 
the Difference 



tailed) Difference Difference Lower 




.687 



-.005 



.012 



-.027 



.018 
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Independent Samples Test Continued 

Levene's Test for Equality of 

Variances t-test for Equality of Means 





















95% Confidence Interval of 














Sig. 12- 
tailed) 


Mean 


Std. Error 


the Difference 






F 


Sig. 


t 


df 


Difference 


Difference 


Lower 


Upper 


Female 


Equal variances 
assumed 


1.391 


.238 


.610 


3884 


.542 


.010 


.016 


-.022 


.041 




Equal variances not 
assumed 






.610 


3883.998 


.542 


.010 


.016 


-.022 


.041 


ELL 


Equal variances 
assumed 


1.649 


.199 


.642 


3886 


.521 


.006 


.010 


-.013 


.025 




Equal variances not 
assumed 






.642 


3883.063 


.521 


.006 


.010 


-.013 


.025 


EconDsvntg 


Equal variances 
assumed 


.069 


.792 


.132 


2084 


.895 


.003 


.022 


-.040 


.046 




Equal variances not 
assumed 






.132 


2084.000 


.895 


.003 


.022 


-.040 


.046 


OAKSRdgTot 


Equal variances 
assumed 


.362 


.547 


-.883 


3670 


.377 


-.315 


.356 


-1.014 


.384 




Equal variances not 
assumed 






-.883 


3668.907 


.377 


-.315 


.356 


-1.014 


.384 


OAKS_Perf 


Equal variances 
assumed 


.402 


.526 


.317 


3670 


.751 


.00340 


.01072 


-.01762 


.02442 




Equal variances not 
assumed 






.317 


3669.347 


.751 


.00340 


.01072 


-.01762 


.02442 


Fall09PRF 


Equal variances 
assumed 


.723 


.395 


-.335 


2207 


.738 


-.574 


1.713 


-3.933 


2.786 




Equal variances not 
assumed 






-.335 


2202.576 


.738 


-.574 


1.713 


-3.934 


2.786 


Fall09MCRC 


Equal variances 
assumed 


.000 


.994 


.193 


2311 


.847 


.033 


.172 


-.305 


.371 




Equal variances not 
assumed 






.193 


2310.992 


.847 


.033 


.172 


-.305 


.371 
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Independent Samples Test Continued 



Levene's Test for Equality of 



Fall09Voc 



WintlOPRF 



WintlOMCRC 



SprlOPRF 



SprlOMCRC 



SprlOVoc 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Variances 



.102 -.914 



-.914 2052.349 



.588 2293.120 



.411 2454.049 



.388 .685 



.685 2213.231 



.679 .344 



.344 2367.825 



.797 -.047 



-.047 2139.411 



t-test for Equality of Means 



Sig. 12- 
tailed) 



.361 



Mean Std. Error 

Difference Difference 



95% Confidence Interval of 
the Difference 
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Grade 4 



Crossvalidation 







Frequency 


Percent 


Valid Percent 


Cumulative Percent 


Valid 


Group 1 


1870 


50.0 


50.0 


50.0 




Group 2 


1870 


50.0 


50.0 


100.0 




Total 


3740 


100.0 


100.0 





EthnicCd 








Valid 


Cumulative 


Crossvalidation 


Frequency 


Percent 


Percent 


Percent 


Group 1 Valid American 


32 


1.7 


1.8 


1.8 


Indian/ Alaskan Native 










Asian/Pacific Islander 


94 


5.0 


5.2 


6.9 


Black 


38 


2.0 


2.1 


9.0 


Hispanic 


436 


23.3 


23.9 


32.9 


White 


1139 


60.9 


62.4 


95.3 


Multi-Ethnic 


55 


2.9 


3.0 


98.3 


Decline/Missing 


31 


1.7 


1.7 


100.0 


Total 


1825 


97.6 


100.0 




Missing System 


45 


2.4 






Total 


1870 


100.0 






Group 2 Valid American 


23 


1.2 


1.3 


1.3 


Indian/ Alaskan Native 










Asian/Pacific Islander 


98 


5.2 


5.4 


6.7 


Black 


47 


2.5 


2.6 


9.2 


Hispanic 


417 


22.3 


22.9 


32.2 


White 


1116 


59.7 


61.4 


93.6 


Multi-Ethnic 


66 


3.5 


3.6 


97.2 


Decline/Missing 


50 


2.7 


2.8 


100.0 


Total 


1817 


97.2 


100.0 




Missing System 


53 


2.8 






Total 


1870 


100.0 
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SPED 















Cumulative 


Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


No 


1526 


81.6 


83.2 


83.2 






Yes 


309 


16.5 


16.8 


100.0 






Total 


1835 


98.1 


100.0 






Missing 


System 


35 


1.9 








Total 




1870 


100.0 






Group 2 


Valid 


No 


1554 


83.1 


85.0 


85.0 






Yes 


274 


14.7 


15.0 


100.0 






Total 


1828 


97.8 


100.0 






Missing 


System 


42 


2.2 








Total 




1870 


100.0 







Female 



Cumulative 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


Male 


988 


52.8 


52.8 


52.8 






Female 


882 


47.2 


47.2 


100.0 






Total 


1870 


100.0 


100.0 




Group 2 


Valid 


Male 


978 


52.3 


52.3 


52.3 






Female 


891 


47.6 


47.7 


100.0 






Total 


1869 


99.9 


100.0 






Missing 


System 


1 


.1 








Total 




1870 


100.0 
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ELL 















Cumulative 


Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


No 


1716 


91.8 


91.8 


91.8 






Yes 


154 


8.2 


8.2 


100.0 






Total 


1870 


100.0 


100.0 




Group 2 


Valid 


No 


1720 


92.0 


92.0 


92.0 






Yes 


149 


8.0 


8.0 


100.0 






Total 


1869 


99.9 


100.0 






Missing 


System 


1 


.1 








Total 




1870 


100.0 







EeonDsvntg 



Cumulative 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


No 


453 


24.2 


44.5 


44.5 






Yes 


565 


30.2 


55.5 


100.0 






Total 


1018 


54.4 


100.0 






Missing 


System 


852 


45.6 








Total 




1870 


100.0 






Group 2 


Valid 


No 


484 


25.9 


48.0 


48.0 






Yes 


524 


28.0 


52.0 


100.0 






Total 


1008 


53.9 


100.0 






Missing 


System 


859 


45.9 










999 


3 


.2 










Total 


862 


46.1 








Total 




1870 


100.0 
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OAKS_Perf 















Cumulative 


Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


.00 


217 


11.6 


12.3 


12.3 






1.00 


1553 


83.0 


87.7 


100.0 






Total 


1770 


94.7 


100.0 






Missing 


System 


100 


5.3 








Total 




1870 


100.0 






Group 2 


Valid 


.00 


225 


12.0 


12.9 


12.9 






1.00 


1525 


81.6 


87.1 


100.0 






Total 


1750 


93.6 


100.0 






Missing 


System 


120 


6.4 








Total 




1870 


100.0 
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Descriptive Statistics 



Crossvalidation 


N 


Minimum 


Maximum 


Mean 


Std. Deviation 


Group 1 


OAKSRdgTot 


1770 


180 


263 


220.92 


10.663 




OAKS_Perf 


1770 


.00 


1.00 


.8774 


.32807 




Fall09PRF 


1127 


0 


263 


109.58 


38.170 




Fall09MCRC 


1147 


0 


20 


11.78 


4.434 




Fall09Voc 


996 


0 


25 


15.83 


4.640 




WintlOPRF 


1105 


6 


269 


131.56 


37.996 




WintlOMCRC 


1174 


0 


20 


13.27 


4.336 




SprlOPRF 


1127 


4 


340 


139.94 


43.660 




SprlOMCRC 


1172 


0 


20 


13.46 


4.142 




SprlOVoc 


1069 


0 


25 


19.32 


4.458 




Valid N (listwise) 


932 










Group 2 


OAKSRdgTot 


1750 


183 


258 


220.91 


10.231 




OAKS_Perf 


1750 


.00 


1.00 


.8714 


.33482 




Fall09PRF 


1143 


0 


254 


109.61 


36.591 




Fall09MCRC 


1147 


0 


20 


12.08 


4.474 




Fall09Voc 


999 


0 


25 


16.15 


4.551 




WintlOPRF 


1112 


4 


269 


133.29 


38.980 




WintlOMCRC 


1171 


0 


20 


13.27 


4.501 




SprlOPRF 


1140 


5 


310 


142.00 


43.277 




SprlOMCRC 


1193 


0 


20 


13.56 


4.317 




SprlOVoc 


1072 


0 


25 


19.56 


4.377 




Valid N (listwise) 


935 















Cross Validation: Oregon Appendix A 

Independent Samples Test 

Levene's Test for Equality of 
Variances 



F Sig. t df 

5.830 .016 1.206 3640 

1.207 3554.874 



AsianPacIslnder Equal variances 
assumed 

Equal variances not 

assumed 

Black Equal variances 

assumed 

Equal variances not 

assumed 

Hispanic Equal variances 

assumed 

Equal variances not 
assumed 

White Equal variances 

assumed 

Equal variances not 
assumed 

Multiethnic Equal variances 

assumed 

Equal variances not 
assumed 

Decline Equal variances 

assumed 

Equal variances not 

assumed 

SPED Equal variances 9.388 .002 1.531 3661 

assumed 

Equal variances not 1.531 3654.137 

assumed 



.430 .512 -.328 3640 

-.328 3637.514 

4.070 B44 -1.008 3640 

-1.008 3596.583 
1.796 T80 B70 3640 

.670 3639.668 
1.514 B19 B16 3640 

.616 3639.678 
4.344 B37 -1.041 3640 

-1.041 3607.922 

18.682 B00 -2.156 3640 

-2.155 3448.225 



Amerind AkNative Equal variances 
assumed 

Equal variances not 
assumed 



t-test for Equality of Means 



Sig. (2- 



Std. Error 



95% Confidence Interval of 
the Difference 



tailed) Difference Difference Lower 




.126 



.019 



.012 



-.005 



.042 














Cross Validation: Oregon 



Appendix A 



Independent Samples Test Continued 



Levene's Test for Equality of 



EconDsvntg 



OAKSRdgTot 



OAKS Perf 



Fall09PRF 



Fall09MCRC 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Variances 



.537 -.310 



-.310 3736.996 



.556 .295 



.295 3736.239 



.004 1.588 



1.588 2023.534 



.016 3514.848 



.534 3514.461 



.123 -.019 



-.019 2260.831 



.842 -1.627 



-1.627 2291.817 



t-test for Equality of Means 



Sig. 12- 
tailed) 



.756 



Mean Std. Error 

Difference Difference 



95% Confidence Interval of 
the Difference 



-.01594 













Cross Validation: Oregon 



Appendix A 



Independent Samples Test Continued 



Levene's Test for Equality of 



Fall09Voc 



WintlOPRF 



WintlOMCRC 



SprlOPRF 



SprlOMCRC 



SprlOVoc 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Variances 



.324 -1.583 



-1.583 1992.005 



.823 -1.056 



-1.056 2214.180 



.010 2339.299 



.635 -1.128 



-1.128 2264.068 



-.570 2361.686 



.605 -1.285 



-1.285 2138.045 



t-test for Equality of Means 



Sig. 12- 
tailed) 



.113 



Mean Std. Error 

Difference Difference 



95% Confidence Interval of 
the Difference 












Cross Validation: Oregon 



Appendix A 



p. 36 



Grade 5 



Crossvalidation 







Frequency 


Percent 


Valid Percent Cumulative Percent 


Valid 


Group 1 


1925 


50.0 




50.0 


50.0 




Group 2 


1926 


50.0 




50.0 


100.0 




Total 


3851 


100.0 




100.0 




EthnicCd 












Valid 


Cumulative 


Crossvalidation 




Frequency 


Percent 


Percent 


Percent 


Group 1 


Valid 


American 

Indian/ Alaskan Native 


32 


1.7 


1.7 


1.7 






Asian/Pacific Islander 


115 


6.0 


6.1 


7.8 






Black 


52 


2.7 


2.8 


10.6 






Hispanic 


422 


21.9 


22.4 


33.0 






White 


1170 


60.8 


62.1 


95.1 






Multi-Ethnic 


45 


2.3 


2.4 


97.5 






Decline/Missing 


48 


2.5 


2.5 


100.0 






Total 


1884 


97.9 


100.0 






Missing 


999 


41 


2.1 








Total 




1925 


100.0 






Group 2 


Valid 


American 

Indian/ Alaskan Native 


29 


1.5 


1.5 


1.5 






Asian/Pacific Islander 


101 


5.2 


5.4 


6.9 






Black 


46 


2.4 


2.5 


9.4 






Hispanic 


404 


21.0 


21.5 


30.9 






White 


1187 


61.6 


63.3 


94.2 






Multi-Ethnic 


58 


3.0 


3.1 


97.3 






Decline/Missing 


51 


2.6 


2.7 


100.0 






Total 


1876 


97.4 


100.0 






Missing 


999 


50 


2.6 








Total 




1926 


100.0 














Cross Validation: Oregon 



Appendix A 



p. 37 



SPED 



Crossvalidation 




Frequency Percent Valid Percent 


Cumulative 

Percent 


Group 1 


Valid 


No 


1588 


82.5 


83.3 


83.3 






Yes 


319 


16.6 


16.7 


100.0 






Total 


1907 


99.1 


100.0 






Missing 


999 


18 


.9 








Total 




1925 


100.0 






Group 2 


Valid 


No 


1612 


83.7 


84.4 


84.4 






Yes 


298 


15.5 


15.6 


100.0 






Total 


1910 


99.2 


100.0 






Missing 


999 


16 


.8 








Total 




1926 


100.0 







Female 

Cumulative 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


Male 


985 


51.2 


51.2 


51.2 






Female 


938 


48.7 


48.8 


100.0 






Total 


1923 


99.9 


100.0 






Missing 


999 


2 


.1 








Total 




1925 


100.0 






Group 2 


Valid 


Male 


1026 


53.3 


53.3 


53.3 






Female 


900 


46.7 


46.7 


100.0 






Total 


1926 


100.0 


100.0 





ELL 



Cumulative 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


No 


1775 


92.2 


92.2 


92.2 






Yes 


150 


7.8 


7.8 


100.0 






Total 


1925 


100.0 


100.0 




Group 2 


Valid 


No 


1794 


93.1 


93.1 


93.1 






Yes 


132 


6.9 


6.9 


100.0 






Total 


1926 


100.0 


100.0 














Cross Validation: Oregon 
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p. 38 



EconDsvntg 



Crossvalidation 




Frequency Percent Valid Percent 


Cumulative 

Percent 


Group 1 


Valid 


No 


495 


25.7 


46.0 


46.0 






Yes 


580 


30.1 


54.0 


100.0 






Total 


1075 


55.8 


100.0 






Missing 


999 


850 


44.2 








Total 




1925 


100.0 






Group 2 


Valid 


No 


537 


27.9 


50.3 


50.3 






Yes 


530 


27.5 


49.7 


100.0 






Total 


1067 


55.4 


100.0 






Missing 


999 


859 


44.6 








Total 




1926 


100.0 













OAKS_ 


_Perf 


















Cumulative 


Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


.00 


360 


18.7 


19.6 


19.6 






1.00 


1479 


76.8 


80.4 


100.0 






Total 


1839 


95.5 


100.0 






Missing 


999.00 


86 


4.5 








Total 




1925 


100.0 






Group 2 


Valid 


.00 


356 


18.5 


19.5 


19.5 






1.00 


1466 


76.1 


80.5 


100.0 






Total 


1822 


94.6 


100.0 






Missing 


999.00 


104 


5.4 








Total 




1926 


100.0 














Cross Validation: Oregon 



Appendix A 



p. 39 



Descriptive Statistics 



Crossvalidation 


N 


Minimum 


Maximum 


Mean 


Std. Deviation 


Group 1 


OAKSRdgTot 


1839 


192 


263 


223.99 


9.107 




OAKS_Perf 


1839 


.00 


1.00 


.8042 


.39689 




Fall09PRF 


1198 


5 


301 


146.82 


41.953 




Fall09MCRC 


1234 


0 


20 


13.54 


3.721 




Fall09Voc 


1087 


0 


25 


18.50 


4.786 




WintlOPRF 


1163 


17 


344 


154.30 


41.619 




WintlOMCRC 


1245 


0 


20 


15.31 


4.146 




SprlOPRF 


1219 


7 


330 


167.48 


41.504 




SprlOMCRC 


1236 


0 


19 


14.12 


3.449 




SprlOVoc 


1120 


0 


25 


20.38 


3.964 




Valid N (listwise) 


986 










Group 2 


OAKSRdgTot 


1822 


189 


267 


224.50 


9.363 




OAKS_Perf 


1822 


.00 


1.00 


.8046 


.39661 




Fall09PRF 


1196 


0 


287 


146.92 


44.487 




Fall09MCRC 


1235 


0 


20 


13.35 


3.780 




Fall09Voc 


1097 


0 


25 


18.33 


4.840 




WintlOPRF 


1162 


10 


293 


153.98 


43.410 




WintlOMCRC 


1228 


0 


20 


15.47 


3.881 




SprlOPRF 


1221 


24 


289 


167.33 


41.639 




SprlOMCRC 


1216 


0 


20 


14.25 


3.195 




SprlOVoc 


1129 


0 


25 


20.29 


3.964 




Valid N (listwise) 


989 















Cross Validation: Oregon Appendix A 

Independent Samples Test 

Levene's Test for Equality of 
Variances 



F Sig. t df 

549 .459 .370 3758 

.370 3751.373 



AsianPacIslnder Equal variances 
assumed 

Equal variances not 

assumed 

Black Equal variances 

assumed 

Equal variances not 

assumed 

Hispanic Equal variances 

assumed 

Equal variances not 
assumed 

White Equal variances 

assumed 

Equal variances not 
assumed 

Multiethnic Equal variances 

assumed 

Equal variances not 
assumed 

Decline Equal variances 

assumed 

Equal variances not 

assumed 

SPED Equal variances 3.571 .059 .945 3815 

assumed 

Equal variances not .945 3811.641 

assumed 



3.604 .058 .949 3758 

.949 3746.814 

1.406 236 393 3758 

.593 3747.363 

1.637 201 M0 3758 

.640 3757.634 

2.200 338 T742 3758 

-.742 3757.984 

6.989 4)08 -1.321 3758 

-1.320 3696.511 
.428 313 3)27 3758 

-.327 3753.188 



Amerind AkNative Equal variances 
assumed 

Equal variances not 
assumed 



t-test for Equality of Means 



p. 40 



95% Confidence Interval of 

Sig. (2- Mean Std. Error the Difference 

tailed) Difference Difference Lower Upper 

~ "002 !oo 4 T007 433" 

.711 .002 .004 -.007 .010 

343 307 308 3)08 322" 

.343 .007 .008 -.008 .022 

353 303 305 3)07 3lT 

.553 .003 .005 -.007 .013 

322 309 314 7(38 335" 

.522 .009 .014 -.018 .035 

338 332 436 3M3 439" 

.458 -.012 .016 -.043 .019 

387 3)07 305 337 303" 

.187 -.007 .005 -.017 .003 

J44 3)02 305 332 309" 

.744 -.002 .005 -.012 .009 

345 433 432 3 3 2 335" 



.345 



.011 



.012 



-.012 



.035 














Cross Validation: Oregon 



Appendix A 



p. 41 



Independent Samples Test Continued 

Levene's Test for Equality of 

Variances t-test for Equality of Means 





















95% Confidence Interval of 














Sig. 12- 
tailed) 


Mean 


Std. Error 


the Difference 






F 


Sig. 


t 


df 


Difference 


Difference 


Lower 


Upper 


Female 


Equal variances 
assumed 


5.366 


.021 


1.272 


3847 


.203 


.020 


.016 


-.011 


.052 




Equal variances not 
assumed 






1.272 


3846.955 


.203 


.020 


.016 


-.011 


.052 


ELL 


Equal variances 
assumed 


5.004 


.025 


1.118 


3849 


.264 


.009 


.008 


-.007 


.026 




Equal variances not 
assumed 






1.118 


3835.393 


.264 


.009 


.008 


-.007 


.026 


EconDsvntg 


Equal variances 
assumed 


6.569 


.010 


1.984 


2140 


.047 


.043 


.022 


.000 


.085 




Equal variances not 
assumed 






1.984 


2139.760 


.047 


.043 


.022 


.000 


.085 


OAKSRdgTot 


Equal variances 
assumed 


1.468 


.226 


-1.643 


3659 


.100 


-.502 


.305 


-1.100 


.097 




Equal variances not 
assumed 






-1.643 


3653.988 


.100 


-.502 


.305 


-1.100 


.097 


OAKS_Perf 


Equal variances 
assumed 


.003 


.955 


-.028 


3659 


.978 


-.00037 


.01311 


-.02608 


.02534 




Equal variances not 
assumed 






-.028 


3658.731 


.978 


-.00037 


.01311 


-.02608 


.02534 


Fall09PRF 


Equal variances 
assumed 


3.563 


.059 


-.058 


2392 


.953 


-.103 


1.767 


-3.569 


3.362 




Equal variances not 
assumed 






-.058 


2383.349 


.953 


-.103 


1.767 


-3.569 


3.363 


Fall09MCRC 


Equal variances 
assumed 


.427 


.514 


1.231 


2467 


.218 


.186 


.151 


-.110 


.482 




Equal variances not 
assumed 






1.231 


2466.449 


.218 


.186 


.151 


-.110 


.482 













Cross Validation: Oregon 



Appendix A 



Independent Samples Test Continued 



Levene's Test for Equality of 



Fall09Voc 



WintlOPRF 



WintlOMCRC 



SprlOPRF 



SprlOMCRC 



SprlOVoc 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Variances 



.490 .805 



.805 2181.990 



.178 2318.718 



.063 -1.009 



-1.010 2464.300 



.093 2437.994 



-.958 2441.168 



.532 2246.858 



Sig. 12- 
tailed) 



t-test for Equality of Means 



Mean Std. Error 

Difference Difference 



95% Confidence Interval of 
the Difference 












Cross Validation: Oregon 



Appendix A 



p. 43 



Grade 6 



Crossvalidation 







Frequency 


Percent 


Valid Percent 


Cumulative 

Percent 


Valid 


Group 1 


1925 


31.3 


50.0 


50.0 




Group 2 


1926 


31.4 


50.0 


100.0 




Total 


3851 


62.7 


100.0 




Missing 


System 


2291 


37.3 






Total 




6142 


100.0 







EthnicCd 









Valid 


Cumulative 


Crossvalidation 


Frequency 


Percent 


Percent 


Percent 


Group 1 Valid American 


32 


1.7 


1.7 


1.7 


Indian/Alaskan Native 










Asian/Pacific Islander 


87 


4.5 


4.6 


6.3 


Black 


47 


2.4 


2.5 


8.8 


Hispanic 


127 


6.6 


6.7 


15.5 


White 


1238 


64.3 


65.5 


81.0 


Mult-Ethnic 


81 


4.2 


4.3 


85.3 


Decline/Missing 


278 


14.4 


14.7 


100.0 


Total 


1890 


98.2 


100.0 




Missing 999 


35 


1.8 






Total 


1925 


100.0 






Group 2 Valid American 


27 


1.4 


1.4 


1.4 


Indian/Alaskan Native 










Asian/Pacific Islander 


87 


4.5 


4.6 


6.1 


Black 


37 


1.9 


2.0 


8.0 


Hispanic 


133 


6.9 


7.1 


15.1 


White 


1231 


63.9 


65.4 


80.5 


Mult-Ethnic 


70 


3.6 


3.7 


84.3 


Decline/Missing 


296 


15.4 


15.7 


100.0 


Total 


1881 


97.7 


100.0 




Missing 999 


45 


2.3 






Total 


1926 


100.0 













Cross Validation: Oregon 
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p. 44 



SpEd 



Crossvalidation 




Frequency Percent Valid Percent 


Cumulative 

Percent 


Group 1 


Valid 


No 


1589 


82.5 


84.1 


84.1 






Yes 


301 


15.6 


15.9 


100.0 






Total 


1890 


98.2 


100.0 






Missing 


999 


35 


1.8 








Total 




1925 


100.0 






Group 2 


Valid 


No 


1557 


80.8 


82.8 


82.8 






Yes 


324 


16.8 


17.2 


100.0 






Total 


1881 


97.7 


100.0 






Missing 


999 


45 


2.3 








Total 




1926 


100.0 







Female 

Cumulative 



Cross validation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


Male 


941 


48.9 


50.9 


50.9 






Female 


906 


47.1 


49.1 


100.0 






Total 


1847 


95.9 


100.0 






Missing 


999 


78 


4.1 








Total 




1925 


100.0 






Group 2 


Valid 


Male 


940 


48.8 


51.0 


51.0 






Female 


903 


46.9 


49.0 


100.0 






Total 


1843 


95.7 


100.0 






Missing 


999 


83 


4.3 








Total 




1926 


100.0 
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p. 45 



ELL 



Crossvalidation 




Frequency Percent Valid Percent 


Cumulative 

Percent 


Group 1 


Valid 


No 


1729 


89.8 


93.5 


93.5 






Yes 


121 


6.3 


6.5 


100.0 






Total 


1850 


96.1 


100.0 






Missing 


999 


75 


3.9 








Total 




1925 


100.0 






Group 2 


Valid 


No 


1725 


89.6 


94.4 


94.4 






Yes 


103 


5.3 


5.6 


100.0 






Total 


1828 


94.9 


100.0 






Missing 


999 


98 


5.1 








Total 




1926 


100.0 







EeonDsvntg 

Cumulative 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 Valid 


No 


514 


26.7 


50.5 


50.5 




Yes 


504 


26.2 


49.5 


100.0 




Total 


1018 


52.9 


100.0 




Missing 


System 


906 


47.1 








999 


1 


.1 








Total 


907 


47.1 






Total 




1925 


100.0 






Group 2 Valid 


No 


506 


26.3 


50.8 


50.8 




Yes 


491 


25.5 


49.2 


100.0 




Total 


997 


51.8 


100.0 




Missing 


System 


925 


48.0 








999 


4 


.2 








Total 


929 


48.2 






Total 




1926 


100.0 
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OAKS_Perf 

Cumulative 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


.00 


371 


19.3 


20.2 


20.2 






1.00 


1464 


76.1 


79.8 


100.0 






Total 


1835 


95.3 


100.0 






Missing 


999.00 


90 


4.7 








Total 




1925 


100.0 






Group 2 


Valid 


.00 


381 


19.8 


21.0 


21.0 






1.00 


1430 


74.2 


79.0 


100.0 






Total 


1811 


94.0 


100.0 






Missing 


999.00 


115 


6.0 








Total 




1926 


100.0 
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Descriptive Statistics 3 



Crossvalidation 


N 


Minimum 


Maximum 


Mean 


Std. Deviation 


Group 1 


OAKSRdgTot 


1835 


0 


271 


225.73 


27.592 




OAKS_Perf 


1835 


.00 


1.00 


.7978 


.40174 




Fall09PRF 


579 


9 


305 


139.65 


40.137 




Fall09MCRC 


1175 


0 


20 


14.01 


3.677 




Fall09Voc 


1047 


0 


25 


15.14 


4.540 




WintlOPRF 


549 


0 


320 


154.33 


42.878 




WintlOMCRC 


625 


0 


20 


13.08 


4.025 




SprlOPRF 


598 


1 


332 


160.10 


49.534 




SprlOMCRC 


1124 


0 


20 


14.53 


3.433 




SprlOVoc 


997 


0 


25 


16.20 


4.511 




Valid N (listwise) 


324 










Group 2 


OAKSRdgTot 


1811 


0 


272 


226.14 


25.723 




OAKS_Perf 


1811 


.00 


1.00 


.7896 


.40769 




Fall09PRF 


581 


16 


298 


140.73 


40.529 




Fall09MCRC 


1176 


0 


20 


14.15 


3.571 




Fall09Voc 


1029 


0 


25 


15.14 


4.550 




WintlOPRF 


530 


0 


287 


157.73 


41.936 




WintlOMCRC 


604 


0 


20 


12.79 


4.269 




SprlOPRF 


593 


6 


303 


164.54 


50.597 




SprlOMCRC 


1138 


0 


20 


14.58 


3.411 




SprlOVoc 


1004 


0 


25 


16.34 


4.441 




Valid N (listwise) 


301 











a. No statistics are computed for one or more split files because there are no valid cases. 








Cross Validation: Oregon Appendix A 

Independent Samples Test 

Levene's Test for Equality of 
Variances 



F Sig. t df 

1.626 .202 .637 3769 

.638 3747.176 



AsianPacIslnder Equal variances 
assumed 

Equal variances not 

assumed 

Black Equal variances 

assumed 

Equal variances not 

assumed 

Hispanic Equal variances 

assumed 

Equal variances not 
assumed 

White Equal variances 

assumed 

Equal variances not 
assumed 

Multiethnic Equal variances 

assumed 

Equal variances not 
assumed 

Decline Equal variances 

assumed 

Equal variances not 

assumed 

SpEd Equal variances 4.604 .032 -1.072 3769 

assumed 

Equal variances not -1.072 3764.073 

assumed 



.004 .949 -.032 3769 

-.032 3768.813 
4.682 HI 1381 3769 

1.082 3724.484 

.724 395 7425 3769 

-.425 3765.973 

.006 Ho 338 3769 

.038 3768.899 
3.125 377 384 3769 

.884 3754.202 

3.085 379 7878 3769 

-.878 3765.032 



Amerind AkNative Equal variances 
assumed 

Equal variances not 
assumed 



t-test for Equality of Means 



Sig. (2- 



Std. Error 



95% Confidence Interval of 
the Difference 



tailed) Difference Difference Lower 




.284 



-.013 



.012 



-.037 



.011 
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Independent Samples Test Continued 

Levene's Test for Equality of 

Variances t-test for Equality of Means 





















95% Confidence Interval of 














Sig. 12- 
tailed) 


Mean 


Std. Error 


the Difference 






F 


Sig. 


t 


df 


Difference 


Difference 


Lower 


Upper 


Female 


Equal variances 
assumed 


.005 


.945 


.034 


3688 


.973 


.001 


.016 


-.032 


.033 




Equal variances not 
assumed 






.034 


3687.983 


.973 


.001 


.016 


-.032 


.033 


ELL 


Equal variances 
assumed 


5.285 


.022 


1.149 


3676 


.251 


.009 


.008 


-.006 


.025 




Equal variances not 
assumed 






1.149 


3663.814 


.251 


.009 


.008 


-.006 


.025 


EconDsvntg 


Equal variances 
assumed 


.053 


.818 


.117 


2013 


.907 


.003 


.022 


-.041 


.046 




Equal variances not 
assumed 






.117 


2012.129 


.907 


.003 


.022 


-.041 


.046 


OAKSRdgTot 


Equal variances 
assumed 


.163 


.687 


-.455 


3644 


.649 


-.402 


.884 


-2.135 


1.330 




Equal variances not 
assumed 






-.455 


3632.241 


.649 


-.402 


.883 


-2.134 


1.330 


OAKS_Perf 


Equal variances 
assumed 


1.497 


.221 


.612 


3644 


.541 


.00820 


.01341 


-.01808 


.03448 




Equal variances not 
assumed 






.612 


3641.169 


.541 


.00820 


.01341 


-.01808 


.03449 


Fall09PRF 


Equal variances 
assumed 


.566 


.452 


-.454 


1158 


.650 


-1.075 


2.368 


-5.722 


3.572 




Equal variances not 
assumed 






-.454 


1157.955 


.650 


-1.075 


2.368 


-5.722 


3.572 


Fall09MCRC 


Equal variances 
assumed 


.181 


.671 


-.910 


2349 


.363 


-.136 


.150 


-.429 


.157 




Equal variances not 
assumed 






-.910 


2346.871 


.363 


-.136 


.150 


-.429 


.157 
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Independent Samples Test Continued 



Levene's Test for Equality of 



Fall09Voc 



WintlOPRF 



WintlOMCRC 



SprlOPRF 



SprlOMCRC 



SprlOVoc 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Variances 



.802 -.003 



.850 -1.318 



.188 1.254 



.616 -1.531 



.896 -.346 



.691 -.715 



-.715 1997.991 



Sig. 12- 

tailed) 



t-test for Equality of Means 



Mean Std. Error 

Difference Difference 



95% Confidence Interval of 
the Difference 



-.003 2073.193 



-1.318 1076.816 



1.253 1216.519 



-1.531 1187.956 



-.346 2259.200 
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Grade 7 



Crossvalidation 







Frequency 


Percent 


Valid Percent 


Cumulative Percent 


Valid 


Group 1 


1800 


50.0 


50.0 


50.0 




Group 2 


1800 


50.0 


50.0 


100.0 




Total 


3600 


100.0 


100.0 





EthnicCd 








Valid 


Cumulative 


Crossvalidation 


Frequency 


Percent 


Percent 


Percent 


Group 1 Valid American 


16 


.9 


.9 


.9 


Indian/ Alaskan Native 










Asian/Pacific Islander 


102 


5.7 


5.8 


6.7 


Black 


35 


1.9 


2.0 


8.7 


Hispanic 


368 


20.4 


20.8 


29.5 


White 


1153 


64.1 


65.3 


94.8 


Multi-ethnic 


61 


3.4 


3.5 


98.3 


Decline/Missing 


30 


1.7 


1.7 


100.0 


Total 


1765 


98.1 


100.0 




Missing 999 


35 


1.9 






Total 


1800 


100.0 






Group 2 Valid American 


18 


1.0 


1.0 


1.0 


Indian/ Alaskan Native 










Asian/Pacific Islander 


92 


5.1 


5.2 


6.3 


Black 


43 


2.4 


2.4 


8.7 


Hispanic 


373 


20.7 


21.2 


29.9 


White 


1137 


63.2 


64.7 


94.6 


Multi-ethnic 


63 


3.5 


3.6 


98.2 


Decline/Missing 


31 


1.7 


1.8 


100.0 


Total 


1757 


97.6 


100.0 




Missing 999 


43 


2.4 






Total 


1800 


100.0 
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SPED 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Cumulative 

Percent 


Group 1 


Valid 


No 


1542 


85.7 


85.7 


85.7 






Yes 


258 


14.3 


14.3 


100.0 






Total 


1800 


100.0 


100.0 




Group 2 


Valid 


No 


1535 


85.3 


85.3 


85.3 






Yes 


265 


14.7 


14.7 


100.0 






Total 


1800 


100.0 


100.0 





Female 

Cumulative 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


0 


887 


49.3 


49.3 


49.3 






1 


911 


50.6 


50.7 


100.0 






Total 


1798 


99.9 


100.0 






Missing 


999 


2 


.1 








Total 




1800 


100.0 






Group 2 


Valid 


0 


916 


50.9 


51.1 


51.1 






1 


877 


48.7 


48.9 


100.0 






Total 


1793 


99.6 


100.0 






Missing 


999 


7 


.4 








Total 




1800 


100.0 







ELL 

Cumulative 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


No 


1714 


95.2 


95.2 


95.2 






Yes 


86 


4.8 


4.8 


100.0 






Total 


1800 


100.0 


100.0 




Group 2 


Valid 


No 


1702 


94.6 


94.6 


94.6 






Yes 


98 


5.4 


5.4 


100.0 






Total 


1800 


100.0 


100.0 
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EconDsvntg 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Cumulative 

Percent 


Group 1 Valid 


0 


529 


29.4 


54.5 


54.5 




1 


441 


24.5 


45.5 


100.0 




Total 


970 


53.9 


100.0 




Missing 


999 


2 


.1 








System 


828 


46.0 








Total 


830 


46.1 






Total 




1800 


100.0 






Group 2 Valid 


0 


480 


26.7 


50.7 


50.7 




1 


466 


25.9 


49.3 


100.0 




Total 


946 


52.6 


100.0 




Missing 


999 


1 


.1 








System 


853 


47.4 








Total 


854 


47.4 






Total 




1800 


100.0 










OAKS_ 


_Perf 
















Cumulative 


Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 Valid 


.00 


347 


19.3 


19.7 


19.7 




1.00 


1415 


78.6 


80.3 


100.0 




Total 


1762 


97.9 


100.0 




Missing 


999.00 


38 


2.1 






Total 




1800 


100.0 






Group 2 Valid 


.00 


366 


20.3 


20.8 


20.8 




1.00 


1390 


77.2 


79.2 


100.0 




Total 


1756 


97.6 


100.0 




Missing 


999.00 


44 


2.4 






Total 




1800 


100.0 
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Descriptive Statistics 



Crossvalidation 


N 


Minimum 


Maximum 


Mean 


Std. Deviation 


Group 1 


OAKSRdgTot 


1762 


0 


272 


231.34 


27.205 




OAKS_Perf 


1762 


.00 


1.00 


.8031 


.39780 




Fall09PRF 


1142 


18 


266 


153.47 


37.611 




Fall09MCRC 


1634 


0 


20 


13.80 


3.416 




Fall09Voc 


954 


0 


25 


14.63 


4.497 




WintlOPRF 


1144 


54 


333 


172.64 


45.870 




WintlOMCRC 


1034 


0 


20 


14.48 


3.291 




SprlOPRF 


1215 


28 


292 


160.44 


42.970 




SprlOMCRC 


1664 


0 


19 


12.52 


2.884 




SprlOVoc 


934 


0 


25 


15.78 


5.040 




Valid N (listwise) 


258 










Group 2 


OAKSRdgTot 


1756 


0 


268 


230.45 


29.844 




OAKS_Perf 


1756 


.00 


1.00 


.7916 


.40630 




Fall09PRF 


1152 


21 


290 


152.79 


38.808 




Fall09MCRC 


1611 


0 


20 


13.85 


3.351 




Fall09Voc 


939 


0 


25 


14.67 


4.623 




WintlOPRF 


1161 


15 


301 


170.79 


46.184 




WintlOMCRC 


1030 


0 


20 


14.53 


3.299 




SprlOPRF 


1216 


0 


297 


159.15 


43.702 




SprlOMCRC 


1640 


0 


20 


12.50 


2.974 




SprlOVoc 


919 


0 


25 


15.98 


4.815 




Valid N (listwise) 


255 
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Independent Samples Test 



Levene's Test for Equality 
of Variances 








t-test for Equality of Means 




F Sig. 


t 


df 


Sig. 12- 
tailed) 


Mean Std. Error 

Difference Difference 


95% Confidence Interval of 
the Difference 

Lower Upper 



Amerind AkNative Equal variances .512 .474 -.358 3520 .720 -.001 .003 -.008 .005 



assumed 

Equal variances not -.358 3505.177 .720 -.001 .003 -.008 .005 

assumed 

AsianPacIslnder Equal variances 1.994 .158 .706 3520 .480 .005 .008 -.010 .021 

assumed 

Equal variances not .706 3513.839 .480 .005 .008 -.010 .021 

assumed 

Black Equal variances 3.509 361 -.936 3520 349 7005 305 -.014 305 

assumed 

Equal variances not -.936 3480.168 .349 -.005 .005 -.014 .005 

assumed 

Hispanic Equal variances .305 .581 -.276 3520 .782 -.004 .014 -.031 .023 

assumed 

Equal variances not -.276 3519.562 .782 -.004 .014 -.031 .023 

assumed 

White Equal variances 382 346 381 3520 303 306 313 7025 338 

assumed 

Equal variances not .381 3519.740 .703 .006 .016 -.025 .038 

assumed 

Multiethnic Equal variances 374 377 7209 3520 335 Tool 306 ToB 31T 

assumed 

Equal variances not -.209 3518.255 .835 -.001 .006 -.013 .011 

assumed 

Decline Equal variances .086 .769 -.147 3520 .883 -.001 .004 -.009 .008 

assumed 

Equal variances not -.147 3518.158 .883 -.001 .004 -.009 .008 

assumed 

SPED Equal variances 338 308 7331 3598 J41 -.004 M2 7027 319 

assumed 

Equal variances not -.331 3597.556 .741 -.004 .012 -.027 .019 

assumed 
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Independent Samples Test Continued 

Levene's Test for Equality 

of V ariances t-test for Equality of Means 





















95% Confidence Interval of 














Sig. (2- 
tailed) 


Mean 


Std. Error 


the Difference 






F 


Sis- 


t 


df 


Difference 


Difference 


Lower 


Upper 


Female 


Equal variances 
assumed 


.240 


.624 


1.052 


3589 


.293 


.018 


.017 


-.015 


.050 




Equal variances not 
assumed 






1.052 


3588.975 


.293 


.018 


.017 


-.015 


.050 


ELL 


Equal variances 
assumed 


3.301 


.069 


-.908 


3598 


.364 


-.007 


.007 


-.021 


.008 




Equal variances not 
assumed 






-.908 


3584.347 


.364 


-.007 


.007 


-.021 


.008 


EconDsvntg 


Equal variances 
assumed 


7.241 


.007 


-1.664 


1914 


.096 


-.038 


.023 


-.083 


.007 




Equal variances not 
assumed 






-1.664 


1912.380 


.096 


-.038 


.023 


-.083 


.007 


OAKSRdgTot 


Equal variances 
assumed 


.919 


.338 


.922 


3516 


.357 


.887 


.963 


-1.000 


2.775 




Equal variances not 
assumed 






.921 


3484.072 


.357 


.887 


.963 


-1.001 


2.775 


OAKS_Perf 


Equal variances 
assumed 


2.876 


.090 


.848 


3516 


.397 


.01149 


.01356 


-.01509 


.03807 




Equal variances not 
assumed 






.848 


3513.880 


.397 


.01149 


.01356 


-.01509 


.03808 


Fall09PRF 


Equal variances 
assumed 


.245 


.621 


.425 


2292 


.671 


.679 


1.596 


-2.451 


3.808 




Equal variances not 
assumed 






.425 


2290.832 


.671 


.679 


1.596 


-2.450 


3.808 


Fall09MCRC 


Equal variances 
assumed 


.432 


.511 


-.404 


3243 


.686 


-.048 


.119 


-.281 


.185 




Equal variances not 
assumed 






-.404 


3242.919 


.686 


-.048 


.119 


-.281 


.185 
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Independent Samples Test Continued 



Levene's Test for Equality 



Fall09Voc 



WintlOPRF 



WintlOMCRC 



SprlOPRF 



SprlOMCRC 



SprlOVoc 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



of Variances 



.623 -.160 



-.160 1887.414 



.902 .964 



.964 2302.855 



.848 -.368 



-.368 2061.921 



.570 .731 



.731 2428.373 



.135 3295.319 



.738 -.906 



-.906 1849.397 



t-test for Equality of Means 



Sig. 12- 
tailed) 



.873 



Mean Std. Error 

Difference Difference 



95% Confidence Interval of 
the Difference 

Lower Upper 



-.445 .378 
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Grade 8 



Crossvalidation 







Frequency 


Percent 


Valid Percent Cumulative Percent 


Valid 


Group 1 


1874 


50.0 




50.0 


50.0 




Group 2 


1875 


50.0 




50.0 


100.0 




Total 


3749 


100.0 




100.0 




EthnicCd 












Valid 


Cumulative 


Crossvalidation 




Frequency 


Percent 


Percent 


Percent 


Group 1 


Valid 


American 

Indian/Alaskan Native 


17 


.9 


.9 


.9 






Asian/Pacific Islander 


94 


5.0 


5.1 


6.1 






Black 


48 


2.6 


2.6 


8.7 






Hispanic 


404 


21.6 


22.0 


30.7 






White 


1157 


61.7 


63.1 


93.8 






Multi-Ethnic 


61 


3.3 


3.3 


97.1 






Decline/Missing 


53 


2.8 


2.9 


100.0 






Total 


1834 


97.9 


100.0 






Missing 


System 


40 


2.1 








Total 




1874 


100.0 






Group 2 


Valid 


American 

Indian/Alaskan Native 


22 


1.2 


1.2 


1.2 






Asian/Pacific Islander 


76 


4.1 


4.1 


5.3 






Black 


45 


2.4 


2.5 


7.8 






Hispanic 


408 


21.8 


22.3 


30.1 






White 


1160 


61.9 


63.3 


93.3 






Multi-Ethnic 


52 


2.8 


2.8 


96.2 






Decline/Missing 


70 


3.7 


3.8 


100.0 






Total 


1833 


97.8 


100.0 






Missing 


System 


42 


2.2 








Total 




1875 


100.0 
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SPED 















Cumulative 


Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


No 


1611 


86.0 


86.1 


86.1 






Yes 


261 


13.9 


13.9 


100.0 






Total 


1872 


99.9 


100.0 






Missing 


System 


2 


.1 








Total 




1874 


100.0 






Group 2 


Valid 


No 


1627 


86.8 


86.8 


86.8 






Yes 


247 


13.2 


13.2 


100.0 






Total 


1874 


99.9 


100.0 






Missing 


System 


1 


.1 








Total 




1875 


100.0 






Female 














Cumulative 


Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


Male 


970 


51.8 


51.8 


51.8 






Female 


904 


48.2 


48.2 


100.0 






Total 


1874 


100.0 


100.0 




Group 2 


Valid 


Male 


990 


52.8 


52.8 


52.8 






Female 


885 


47.2 


47.2 


100.0 






Total 


1875 


100.0 


100.0 





ELL 

Cumulative 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 


Valid 


No 


1779 


94.9 


94.9 


94.9 






Yes 


95 


5.1 


5.1 


100.0 






Total 


1874 


100.0 


100.0 




Group 2 


Valid 


No 


1781 


95.0 


95.0 


95.0 






Yes 


94 


5.0 


5.0 


100.0 






Total 


1875 


100.0 


100.0 
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EconDsvntg 



Crossvalidation 




Frequency 


Percent 


Valid Percent 


Cumulative 

Percent 


Group 1 Valid 


No 


540 


28.8 


52.4 


52.4 




Yes 


490 


26.1 


47.6 


100.0 




Total 


1030 


55.0 


100.0 




Missing 


999 


1 


.1 








System 


843 


45.0 








Total 


844 


45.0 






Total 




1874 


100.0 






Group 2 Valid 


No 


555 


29.6 


54.1 


54.1 




Yes 


470 


25.1 


45.9 


100.0 




Total 


1025 


54.7 


100.0 




Missing 


999 


3 


.2 








System 


847 


45.2 








Total 


850 


45.3 






Total 




1875 


100.0 










t/i 

< 

O 


_Perf 
















Cumulative 


Crossvalidation 




Frequency 


Percent 


Valid Percent 


Percent 


Group 1 Valid 


.00 


549 


29.3 


30.6 


30.6 




1.00 


1247 


66.5 


69.4 


100.0 




Total 


1796 


95.8 


100.0 




Missing 


999.00 


78 


4.2 






Total 




1874 


100.0 






Group 2 Valid 


.00 


550 


29.3 


30.5 


30.5 




1.00 


1252 


66.8 


69.5 


100.0 




Total 


1802 


96.1 


100.0 




Missing 


999.00 


73 


3.9 






Total 




1875 


100.0 
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Descriptive Statistics 



Std. 



Crossvalidation 


N 


Minimum 


Maximum 


Mean 


Deviation 


Group 1 


OAKS Read 


1796 


0 


279 


231.09 


27.162 




OAKS_Perf 


1796 


.00 


1.00 


.6943 


.46082 




easyCBM Fluency Score 
Grade 8 Fall 


1183 


8 


397 


169.83 


42.626 




easyCBM Comp Score 
Grade 8 Fall 


1706 


0 


20 


14.04 


3.223 




easyCBM Vocabulary 
Score Grade 8 Fall 


1007 


0 


25 


15.01 


4.105 




easyCBM Fluency Score 
Grade 8 Winter 


1183 


11 


343 


159.84 


43.951 




easyCBM Comp Score 
Grade 8 Winter 


1100 


0 


19 


12.78 


3.070 




easyCBM Fluency Score 
Grade 8 Spring 


1205 


15 


304 


161.66 


39.668 




easyCBM Comp Score 
Grade 8 Spring 


1699 


0 


20 


13.16 


3.231 




easyCBM Vocabulary 
Score Grade 8 Spring 


1015 


0 


25 


16.18 


4.570 




Valid N (listwise) 


297 










Group 2 


OAKS Read 


1802 


0 


273 


231.82 


24.417 




OAKS_Perf 


1802 


.00 


1.00 


.6948 


.46063 




easyCBM Fluency Score 
Grade 8 Fall 


1177 


16 


308 


168.41 


43.715 




easyCBM Comp Score 
Grade 8 Fall 


1716 


0 


20 


13.98 


3.359 




easyCBM Vocabulary 
Score Grade 8 Fall 


1018 


0 


25 


15.10 


4.284 




easyCBM Fluency Score 
Grade 8 Winter 


1181 


10 


303 


159.48 


45.936 




easyCBM Comp Score 
Grade 8 Winter 


1060 


0 


19 


12.56 


3.120 




easyCBM Fluency Score 
Grade 8 Spring 


1204 


22 


304 


160.37 


42.458 




easyCBM Comp Score 
Grade 8 Spring 


1711 


0 


19 


13.01 


3.400 




easyCBM Vocabulary 
Score Grade 8 Spring 


1022 


0 


25 


16.20 


4.664 




Valid N (listwise) 


275 
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Independent Samples Test 

Levene's Test for Equality 
of Variances 



Amerind AkN ati ve 



AsianPacIslnder 



Hispanic 



Multiethnic 



Decline 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



Equal variances 
assumed 

Equal variances not 
assumed 



3606.233 



3628.720 



3661.569 



3664.933 



3664.999 



3643.774 



3600.065 



3741.707 



t-test for Equality of Means 



Sig. (2- Mean Std. Error 

tailed) Difference Difference 



.420 -.003 .003 



95% Confidence Interval of 
the Difference 

Lower Upper 



-.009 .004 
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Independent Samples Test Continued 

Levene's Test for Equality 

of Variances t-test for Equality of Means 





















95% Confidence Interval of 














Sig. 12- 
tailed) 


Mean 


Std. Error 


the Difference 






F 


Sig. 


t 


df 


Difference 


Difference 


Lower 


Upper 


Female 


Equal variances 
assumed 


1.542 


.214 


.637 


3747 


.524 


.010 


.016 


-.022 


.042 




Equal variances not 
assumed 






.637 


3746.992 


.524 


.010 


.016 


-.022 


.042 


ELL 


Equal variances 
assumed 


.025 


.875 


.078 


3747 


.938 


.001 


.007 


-.013 


.015 




Equal variances not 
assumed 






.078 


3746.874 


.938 


.001 


.007 


-.013 


.015 


EconDsvntg 


Equal variances 
assumed 


2.287 


.131 


.781 


2053 


.435 


.017 


.022 


-.026 


.060 




Equal variances not 
assumed 






.781 


2052.986 


.435 


.017 


.022 


-.026 


.060 


OAKS Read 


Equal variances 
assumed 


.412 


.521 


-.847 


3596 


.397 


-.729 


.861 


-2.418 


.959 




Equal variances not 
assumed 






-.847 


3553.442 


.397 


-.729 


.861 


-2.418 


.959 


OAKS_Perf 


Equal variances 
assumed 


.004 


.952 


-.030 


3596 


.976 


-.00046 


.01536 


-.03058 


.02966 




Equal variances not 
assumed 






-.030 


3595.949 


.976 


-.00046 


.01536 


-.03058 


.02966 


easyCBM Passage 


Equal variances 


.104 


.747 


.802 


2358 


.423 


1.426 


1.777 


-2.060 


4.911 


Reading Fluency Score 


assumed 




















Grade 8 Fall 


Equal variances not 
assumed 






.802 


2355.836 


.423 


1.426 


1.778 


-2.060 


4.911 


easyCBM Multiple 


Equal variances 


2.065 


.151 


.504 


3420 


.614 


.057 


.113 


-.164 


.277 


Choice Read Comp 


assumed 




















Score Grade 8 Fall 


Equal variances not 
assumed 






.504 


3415.769 


.614 


.057 


.113 


-.164 


.277 
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Independent Samples Test Continued 

Levene's Test for Equality 

of Variances t-test for Equality of Means 

95% Confidence Interval of 















Sig. 12- 
tailed) 


Mean 


Std. Error 


the Difference 






F 


Sig. 


t 


df 


Difference 


Difference 


Lower 


Upper 


easyCBM Vocabulary 


Equal variances 


2.056 


.152 


-.505 


2023 


.613 


-.094 


.186 


-.460 


.272 


Score Grade 8 Fall 


assumed 






















Equal variances not 
assumed 






-.505 


2020.954 


.613 


-.094 


.186 


-.460 


.271 


easyCBM Passage 


Equal variances 


1.379 


.240 


.192 


2362 


.848 


.355 


1.849 


-3.271 


3.981 


Reading Fluency Score 


assumed 




















Grade 8 Winter 


Equal variances not 
assumed 






.192 


2357.046 


.848 


.355 


1.849 


-3.271 


3.981 


easyCBM Multiple 


Equal variances 


.710 


.400 


1.663 


2158 


.097 


.221 


.133 


-.040 


.483 


Choice Read Comp 


assumed 




















Score Grade 8 Winter 


Equal variances not 
assumed 






1.662 


2151.905 


.097 


.221 


.133 


-.040 


.483 


easyCBM Passage 


Equal variances 


3.765 


.052 


.771 


2407 


.441 


1.290 


1.674 


-1.993 


4.573 


Reading Fluency Score 


assumed 




















Grade 8 Spring 


Equal variances not 
assumed 






.771 


2395.690 


.441 


1.290 


1.674 


-1.993 


4.573 


easyCBM Multiple 


Equal variances 


7.652 


.006 


1.327 


3408 


.185 


.151 


.114 


-.072 


.373 


Choice Reading 


assumed 




















Comprehension Score 


Equal variances not 






1.327 


3401.417 


.185 


.151 


.114 


-.072 


.373 


Grade 8 Spring 


assumed 




















easyCBM Vocabulary 


Equal variances 


.606 


.436 


-.104 


2035 


.917 


-.021 


.205 


-.423 


.380 


Score Grade 8 Spring 


assumed 






















Equal variances not 






-.104 


2034.630 


.917 


-.021 


.205 


-.423 


.380 



assumed 
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Appendix B: ROC Analyses 


Grade 3 

Fall PRF Benchmark 


Case Processing Summary b 




Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


116 




Negative 


961 




Missing 


867 


Group 2 


Positive 3 


116 




Negative 


952 




Missing 


876 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09PRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09PRF 











Asymptotic 95% Confidence 








Asymptotic 


Interval 


Crossvalidation 


Area 


Std. Error 3 


Sig- b 


Lower Bound Upper Bound 


Group 1 


.908 


.012 


.000 


.884 .932 


Group 2 






.000 


.882 .932 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09PRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09PRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 









Cross Validation: Oregon 



Appendix B 



p. 66 



ROC Curve 

Ciossvalidation: Group 1 




ROC Curve 

Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 3 

Fall PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


1.00 


- 


- 


.000 


1.000 


2.00 


.000 


1.000 


- 


- 


3.50 


.000 


.999 


.009 


1.000 


5.50 


.009 


.999 


.017 


1.000 


8.00 


.017 


.999 


.026 


1.000 


9.50 


.026 


.999 


- 


- 


10.50 


- 


- 


.060 


.999 


11.00 


.034 


.998 


- 


- 


11.50 


- 


- 


.103 


.999 


12.50 


.052 


.997 


- 


- 


13.00 


- 


- 


.112 


.999 


13.50 


.078 


.997 


- 


- 


14.50 


.086 


.997 


.121 


.999 


15.50 


.095 


.997 


- 


- 


16.50 


.112 


.997 


.147 


.997 


17.50 


.129 


.997 


- 


- 


18.50 


.181 


.996 


.155 


.997 


19.50 


.198 


.996 


.190 


.997 


20.50 


.233 


.996 


.224 


.996 


21.50 


.259 


.996 


.241 


.996 


22.50 


.267 


.994 


.241 


.995 


23.50 


.302 


.992 


.250 


.995 


24.50 


.319 


.989 


.284 


.993 


25.50 


.336 


.988 


.293 


.991 


26.50 


.371 


.983 


.328 


.985 


27.50 


.388 


.980 


.345 


.979 


28.50 


.405 


.975 


.362 


.974 


29.50 


.414 


.971 


.388 


.972 


30.50 


.466 


.968 


.397 


.971 


31.50 


.466 


.964 


.440 


.965 


32.50 


.474 


.963 


.457 


.961 


33.50 


.491 


.958 


.483 


.957 


34.50 


.509 


.952 


.491 


.953 


35.50 


.552 


.947 


.500 


.949 


36.50 


.560 


.944 


.517 


.947 


37.50 


.586 


.940 


.552 


.944 


38.50 


.603 


.934 


.560 


.943 


39.50 


.603 


.931 


.578 


.939 





Cross Validation: Oregon 



Appendix B 



p. 68 



Grade 3 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


40.50 


.638 


.925 


.578 


.933 


41.50 


.638 


.924 


.578 


.926 


42.50 


- 


- 


.612 


.923 


43.50 


- 


- 


.629 


.918 


44.50 


.647 


.916 


.629 


.914 


45.50 


.647 


.912 


- 


- 


46.50 


.655 


.909 


.664 


.909 


47.50 


.664 


.904 


.664 


.902 


48.50 


.672 


.898 


.664 


.894 


49.50 


.698 


.894 


.664 


.890 


50.50 


.707 


.891 


.672 


.884 


51.50 


.716 


.880 


.672 


.879 


52.50 


.724 


.873 


.698 


.879 


53.50 


.733 


.870 


.707 


.876 


54.50 


.741 


.864 


.724 


.872 


55.50 


.741 


.857 


.733 


.866 


56.50 


.741 


.851 


.759 


.859 


57.50 


.767 


.840 


.784 


.849 


58.50 


.784 


.829 


.828 


.837 


59.50 


.793 


.820 


.836 


.834 


60.50 


.802 


.807 


.862 


.819 


61.50 


.819 


.793 


.888 


.809 


62.50 


.862 


.785 


.905 


.793 


63.50 


.888 


.770 


.914 


.778 


64.50 


.888 


.761 


.914 


.769 


65.50 


.897 


.750 


.914 


.761 


66.50 


.914 


.746 


.914 


.749 


67.50 


.922 


.739 


.922 


.746 


68.50 


.931 


.732 


.931 


.735 


69.50 


.940 


.724 


.931 


.726 


70.50 


.940 


.717 


.931 


.714 


71.50 


.940 


.700 


.931 


.701 


72.50 


.940 


.689 


.931 


.687 


73.50 


.948 


.684 


.931 


.680 


74.50 


.957 


.670 


.940 


.670 


75.50 


.957 


.660 


.948 


.661 


76.50 


.966 


.647 


.948 


.647 


77.50 


.966 


.638 


.948 


.640 
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Grade 3 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


78.50 


.966 


.619 


.957 


.637 


79.50 


.966 


.610 


.966 


.622 


80.50 


.974 


.602 


.966 


.613 


81.50 


.974 


.595 


.966 


.596 


82.50 


.974 


.587 


.966 


.587 


83.50 


- 


- 


.974 


.571 


84.50 


.974 


.563 


.974 


.555 


85.50 


.974 


.556 


- 


- 


86.50 


.974 


.541 


.974 


.533 


87.50 


.991 


.536 


.974 


.522 


88.50 


.991 


.518 


.974 


.507 


89.50 


.991 


.499 


.974 


.487 


90.50 


.991 


.483 


.974 


.471 


91.50 


.991 


.468 


.974 


.458 


92.50 


.991 


.450 


.974 


.450 


93.50 


.991 


.440 


.974 


.441 


94.50 


.991 


.426 


.974 


.434 


95.50 


.991 


.415 


.983 


.420 


96.50 


.991 


.406 


.983 


.412 


97.50 


.991 


.390 


.991 


.403 


98.50 


.991 


.382 


.991 


.397 


99.50 


.991 


.370 


.991 


.393 


100.50 


.991 


.359 


.991 


.380 


101.50 


.991 


.355 


.991 


.369 


102.50 


.991 


.343 


.991 


.356 


103.50 


.991 


.337 


.991 


.343 


104.50 


.991 


.326 


.991 


.332 


105.50 


.991 


.320 


- 


- 


106.00 


- 


- 


.991 


.324 


106.50 


.991 


.314 


- 


- 


107.50 


1.000 


.309 


.991 


.316 


108.50 


1.000 


.305 


.991 


.310 


109.50 


1.000 


.299 


.991 


.306 


110.50 


1.000 


.285 


.991 


.301 


111.50 


1.000 


.280 


.991 


.296 


112.50 


1.000 


.272 


1.000 


.290 


113.50 


1.000 


.263 


1.000 


.272 


114.50 


1.000 


.253 


1.000 


.266 
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Grade 3 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


115.50 


1.000 


.245 


1.000 


.261 


116.50 


1.000 


.238 


1.000 


.251 


117.50 


1.000 


.231 


1.000 


.242 


118.50 


1.000 


.226 


1.000 


.233 


119.50 


1.000 


.220 


1.000 


.228 


120.50 


1.000 


.212 


1.000 


.224 


121.50 


1.000 


.207 


1.000 


.214 


122.50 


1.000 


.201 


1.000 


.211 


123.50 


- 


- 


1.000 


.208 


124.50 


1.000 


.194 


1.000 


.199 


125.50 


1.000 


.190 


1.000 


.193 


126.50 


1.000 


.186 


- 


- 


127.50 


1.000 


.183 


1.000 


.187 


128.50 


1.000 


.179 


1.000 


.183 


129.50 


1.000 


.173 


1.000 


.173 


130.50 


1.000 


.166 


1.000 


.167 


131.50 


1.000 


.161 


1.000 


.164 


132.50 


1.000 


.154 


1.000 


.158 


133.50 


1.000 


.152 


1.000 


.154 


134.50 


1.000 


.145 


1.000 


.150 


135.50 


1.000 


.144 


1.000 


.149 


136.50 


1.000 


.132 


1.000 


.146 


137.50 


1.000 


.130 


1.000 


.144 


138.50 


1.000 


.127 


1.000 


.141 


139.50 


1.000 


.121 


1.000 


.134 


140.50 


1.000 


.118 


1.000 


.127 


141.50 


1.000 


.112 


1.000 


.125 


142.50 


1.000 


.107 


1.000 


.121 


143.50 


1.000 


.101 


1.000 


.117 


144.50 


1.000 


.096 


1.000 


.112 


145.50 


1.000 


.092 


1.000 


.110 


146.50 


1.000 


.086 


1.000 


.106 


147.50 


1.000 


.083 


1.000 


.104 


148.50 


1.000 


.077 


1.000 


.100 


149.50 


1.000 


.073 


1.000 


.099 


150.50 


1.000 


.069 


1.000 


.096 


151.50 


1.000 


.063 


1.000 


.088 


152.50 


1.000 


.060 


1.000 


.084 
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Grade 3 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


153.50 


1.000 


.058 


1.000 


.083 


154.50 


1.000 


.055 


1.000 


.079 


155.50 


1.000 


.052 


1.000 


.076 


156.50 


1.000 


.048 


1.000 


.072 


158.00 


1.000 


.046 


1.000 


.067 


159.50 


1.000 


.045 


1.000 


.064 


160.50 


1.000 


.043 


1.000 


.062 


161.50 


1.000 


.039 


1.000 


.057 


162.50 


1.000 


.034 


1.000 


.053 


164.50 


1.000 


.032 


1.000 


.051 


165.50 


- 


- 


1.000 


.049 


166.50 


- 


- 


1.000 


.044 


168.00 


- 


- 


1.000 


.040 


168.50 


1.000 


.028 


- 


- 


170.50 


1.000 


.025 


1.000 


.034 


171.50 


1.000 


.023 


1.000 


.033 


172.50 


- 


- 


1.000 


.029 


173.00 


1.000 


.021 


- 


- 


173.50 


- 


- 


1.000 


.027 


174.50 


1.000 


.019 


1.000 


.024 


175.50 


1.000 


.017 


- 


- 


176.00 


- 


- 


1.000 


.023 


176.50 


1.000 


.016 


- 


- 


177.50 


1.000 


.015 


1.000 


.021 


178.50 


- 


- 


1.000 


.016 


179.00 


1.000 


.011 


- 


- 


180.00 


- 


- 


1.000 


.015 


181.50 


1.000 


.010 


- 


- 


182.00 


- 


- 


1.000 


.013 


185.50 


1.000 


.008 


- 


- 


187.00 


- 


- 


1.000 


.012 


188.50 


1.000 


.007 


- 


- 


190.50 


1.000 


.005 


- 


- 


191.50 


- 


- 


1.000 


.011 


192.50 


- 


- 


1.000 


.008 


193.50 


- 


- 


1.000 


.005 


194.00 


1.000 


.004 


- 


- 


195.00 


- 


- 


1.000 


.004 
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Grade 3 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


197.00 


- 


- 


1.000 


.003 


199.00 


1.000 


.003 


- 


- 


202.50 


1.000 


.002 


- 


- 


206.00 


- 


- 


1.000 


.002 


211.00 


1.000 


.001 


- 


- 


220.00 


1.000 


.000 


- 


- 


229.00 


- 


- 


1.000 


.001 


245.00 


- 


- 


1.000 


.000 
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Grade 3 

Fall MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


117 




Negative 


1011 




Missing 


816 


Group 2 


Positive 3 


120 




Negative 


1004 




Missing 


820 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09MCRC has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09MCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.799 


.017 


.000 


.766 .832 


Group 2 


.808 


.017 


.000 


.774 .841 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09MCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09MCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 3 

Fall MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.060 


.972 


.075 


.982 


1.50 


.068 


.970 


.092 


.980 


2.50 


.077 


.967 


.108 


.979 


3.50 


.120 


.955 


.142 


.970 


4.50 


.205 


.940 


.200 


.950 


5.50 


.325 


.908 


.308 


.924 


6.50 


.419 


.860 


.442 


.869 


7.50 


.607 


.805 


.575 


.806 


8.50 


.684 


.737 


.725 


.734 


9.50 


.803 


.658 


.825 


.666 


10.50 


.906 


.585 


.908 


.591 


11.50 


.957 


.503 


.950 


.508 


12.50 


.983 


.412 


.983 


.414 


13.50 


.991 


.301 


.992 


.299 


14.50 


1.000 


.201 


.992 


.195 


15.50 


1.000 


.115 


.992 


.101 


16.50 


1.000 


.046 


.992 


.047 


17.50 


1.000 


.013 


1.000 


.021 


18.50 


1.000 


.001 


1.000 


.005 


19.50 


- 


- 


1.000 


.001 


20.00 


1.000 


.000 


- 


- 


21.00 


- 


- 


1.000 


.000 
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Grade 3 

Fall VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


103 




Negative 


905 




Missing 


936 


Group 2 


Positive 3 


111 




Negative 


896 




Missing 


937 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09Voc has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09Voc 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.919 


.011 


.000 


.898 .940 


Group 2 






.000 


.885 .931 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09Voc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09Voc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 3 

Fall VOC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.000 


.997 


- 


- 


1.00 


- 


- 


.054 


.998 


2.00 


.000 


.996 


- 


- 


2.50 


- 


- 


.054 


.997 


3.50 


.010 


.994 


.072 


.996 


4.50 


.049 


.992 


.090 


.993 


5.50 


.078 


.990 


.135 


.991 


6.50 


.165 


.983 


.225 


.982 


7.50 


.291 


.970 


.297 


.972 


8.50 


.437 


.959 


.459 


.963 


9.50 


.544 


.943 


.514 


.945 


10.50 


.650 


.918 


.604 


.929 


11.50 


.757 


.895 


.694 


.901 


12.50 


.864 


.864 


.784 


.871 


13.50 


.903 


.821 


.847 


.831 


14.50 


.922 


.779 


.874 


.776 


15.50 


.951 


.724 


.910 


.723 


16.50 


.971 


.640 


.937 


.665 


17.50 


.990 


.567 


.982 


.587 


18.50 


1.000 


.470 


1.000 


.525 


19.50 


1.000 


.390 


1.000 


.440 


20.50 


1.000 


.292 


1.000 


.354 


21.50 


1.000 


.210 


1.000 


.246 


22.50 


1.000 


.136 


1.000 


.166 


23.50 


1.000 


.061 


1.000 


.093 


24.50 


1.000 


.020 


1.000 


.033 


26.00 


1.000 


.000 


1.000 


.000 
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Grade 3 

Winter PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


123 




Negative 


998 




Missing 


823 


Group 2 


Positive 3 


122 




Negative 


989 




Missing 


833 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): WintlOPRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): WintlOPRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.907 


.012 


.000 


.883 .932 


Group 2 


.897 


.014 


.000 


.869 .925 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): WintlOPRF has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): WintlOPRF has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 3 

Winter PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


5.00 


- 


- 


.000 


1.000 


6.00 


.000 


1.000 


- 


- 


7.00 


- 


- 


.008 


1.000 


7.50 


.008 


1.000 


- 


- 


8.50 


.016 


1.000 


.016 


1.000 


9.50 


.024 


1.000 


.033 


1.000 


10.50 


.033 


1.000 


- 


- 


11.00 


- 


- 


.041 


1.000 


11.50 


.041 


1.000 


- 


- 


12.50 


.049 


.999 


.057 


.999 


13.50 


.049 


.996 


.057 


.997 


14.50 


- 


- 


.082 


.992 


15.50 


.049 


.993 


.082 


.991 


17.50 


.065 


.993 


.107 


.991 


19.00 


.073 


.993 


- 


- 


19.50 


- 


- 


.115 


.991 


20.50 


.081 


.992 


- 


- 


21.00 


- 


- 


.123 


.991 


21.50 


.089 


.992 


- 


- 


22.50 


.106 


.992 


.131 


.991 


23.50 


- 


- 


.148 


.991 


24.00 


.114 


.992 


- 


- 


24.50 


- 


- 


.156 


.991 


25.50 


.122 


.992 


.164 


.990 


26.50 


.130 


.992 


.189 


.990 


27.50 


- 


- 


.197 


.990 


28.50 


- 


- 


.205 


.990 


29.00 


.138 


.992 


- 


- 


30.50 


- 


- 


.213 


.988 


31.50 


.163 


.992 


- 


- 


32.50 


.163 


.991 


.230 


.988 


33.50 


.163 


.990 


.254 


.988 


34.50 


.171 


.990 


.270 


.988 


35.50 


.187 


.989 


- 


- 


36.00 


- 


- 


.287 


.987 


36.50 


.203 


.989 


- 


- 


37.50 


.220 


.989 


.295 


.987 


38.50 


.228 


.989 


- 


- 





Cross Validation: Oregon 



Appendix B 



p. 82 



Grade 3 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


39.50 


.236 


.988 


- 


- 


40.00 


- 


- 


.295 


.986 


40.50 


.252 


.985 


- 


- 


42.00 


.268 


.984 


- 


- 


42.50 


- 


- 


.303 


.985 


44.00 


.301 


.983 


.311 


.985 


45.50 


.309 


.981 


.320 


.985 


46.50 


.333 


.981 


.320 


.984 


47.50 


.350 


.979 


.320 


.982 


48.50 


.358 


.979 


.336 


.978 


50.00 


.374 


.979 


- 


- 


50.50 


- 


- 


.344 


.978 


52.00 


.382 


.977 


- 


- 


52.50 


- 


- 


.352 


.977 


53.50 


.390 


.976 


.361 


.977 


54.50 


.398 


.974 


.361 


.976 


55.50 


.423 


.973 


.369 


.975 


56.50 


.431 


.973 


.385 


.973 


57.50 


.439 


.972 


.393 


.973 


58.50 


.439 


.970 


.402 


.973 


59.50 


.447 


.969 


.410 


.973 


60.50 


.463 


.967 


.426 


.971 


61.50 


.472 


.964 


.434 


.971 


62.50 


.480 


.962 


.443 


.967 


63.50 


.504 


.960 


.451 


.966 


64.50 


.512 


.959 


- 


- 


65.00 


- 


- 


.459 


.963 


65.50 


.520 


.959 


- 


- 


66.50 


.528 


.956 


.467 


.960 


67.50 


.537 


.952 


.467 


.954 


68.50 


.545 


.948 


.475 


.949 


69.50 


.553 


.946 


.492 


.943 


70.50 


.561 


.944 


.508 


.940 


71.50 


.585 


.938 


.516 


.931 


72.50 


.610 


.937 


.533 


.924 


73.50 


.626 


.932 


.549 


.919 


74.50 


.650 


.926 


.557 


.915 
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Grade 3 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


75.50 


.675 


.925 


.615 


.914 


76.50 


.699 


.920 


.615 


.904 


77.50 


.699 


.915 


.648 


.899 


78.50 


.715 


.906 


.672 


.891 


79.50 


.756 


.898 


.705 


.884 


80.50 


.780 


.882 


.746 


.873 


81.50 


.780 


.870 


.787 


.867 


82.50 


.797 


.863 


.795 


.855 


83.50 


.813 


.856 


.803 


.844 


84.50 


.821 


.847 


.803 


.837 


85.50 


.837 


.835 


.820 


.830 


86.50 


.837 


.827 


.836 


.822 


87.50 


.846 


.816 


.836 


.812 


88.50 


.854 


.807 


.844 


.803 


89.50 


.854 


.802 


.861 


.800 


90.50 


.854 


.794 


.861 


.797 


91.50 


.854 


.790 


.869 


.792 


92.50 


.862 


.787 


.877 


.786 


93.50 


.862 


.770 


.885 


.779 


94.50 


.878 


.760 


.885 


.764 


95.50 


.878 


.747 


.893 


.749 


96.50 


.886 


.741 


.902 


.748 


97.50 


.886 


.735 


.902 


.741 


98.50 


.886 


.723 


.910 


.732 


99.50 


.894 


.714 


.926 


.721 


100.50 


.902 


.709 


.934 


.709 


101.50 


.902 


.702 


.934 


.703 


102.50 


.911 


.684 


.951 


.692 


103.50 


.911 


.675 


.951 


.683 


104.50 


.911 


.668 


.959 


.673 


105.50 


.919 


.658 


.959 


.665 


106.50 


.935 


.646 


.959 


.658 


107.50 


.935 


.635 


.959 


.649 


108.50 


.943 


.629 


.959 


.637 


109.50 


.951 


.615 


.959 


.620 


110.50 


.951 


.607 


.959 


.610 


111.50 


.951 


.596 


.959 


.595 
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Grade 3 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


112.50 


.959 


.584 


.959 


.586 


113.50 


.959 


.579 


.959 


.579 


114.50 


.959 


.576 


.959 


.576 


115.50 


.967 


.566 


.959 


.566 


116.50 


.967 


.561 


.959 


.550 


117.50 


.967 


.555 


.959 


.542 


118.50 


.976 


.545 


.959 


.534 


119.50 


.976 


.529 


.959 


.525 


120.50 


.984 


.519 


.959 


.522 


121.50 


.984 


.515 


.959 


.514 


122.50 


.984 


.503 


.959 


.505 


123.50 


.984 


.498 


.959 


.495 


124.50 


.984 


.487 


.959 


.490 


125.50 


.984 


.475 


.967 


.478 


126.50 


.984 


.452 


.975 


.463 


127.50 


.984 


.449 


.975 


.459 


128.50 


.984 


.441 


.975 


.451 


129.50 


.984 


.437 


.975 


.444 


130.50 


.992 


.425 


.975 


.434 


131.50 


.992 


.410 


.975 


.419 


132.50 


1.000 


.402 


.984 


.397 


133.50 


1.000 


.396 


.984 


.392 


134.50 


1.000 


.392 


.984 


.379 


135.50 


1.000 


.384 


.984 


.372 


136.50 


1.000 


.383 


.984 


.370 


137.50 


1.000 


.372 


.984 


.363 


138.50 


1.000 


.368 


.984 


.359 


139.50 


1.000 


.362 


.984 


.355 


140.50 


1.000 


.358 


.984 


.346 


141.50 


1.000 


.355 


.984 


.344 


142.50 


1.000 


.353 


.984 


.339 


143.50 


1.000 


.345 


.984 


.327 


144.50 


1.000 


.338 


.984 


.324 


145.50 


1.000 


.329 


.984 


.313 


146.50 


1.000 


.316 


.992 


.304 


147.50 


1.000 


.303 


.992 


.295 
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Grade 3 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


148.50 


1.000 


.300 


.992 


.289 


149.50 


1.000 


.289 


.992 


.285 


150.50 


1.000 


.283 


.992 


.280 


151.50 


1.000 


.279 


.992 


.277 


152.50 


1.000 


.268 


.992 


.269 


153.50 


1.000 


.263 


.992 


.267 


154.50 


1.000 


.257 


.992 


.264 


155.50 


1.000 


.246 


.992 


.255 


156.50 


1.000 


.240 


.992 


.242 


157.50 


1.000 


.230 


.992 


.235 


158.50 


1.000 


.225 


.992 


.225 


159.50 


1.000 


.217 


.992 


.217 


160.50 


1.000 


.203 


.992 


.200 


161.50 


1.000 


.198 


.992 


.196 


162.50 


1.000 


.190 


.992 


.187 


163.50 


1.000 


.181 


.992 


.182 


164.50 


1.000 


.177 


.992 


.178 


165.50 


1.000 


.170 


.992 


0.175 


166.50 


1.000 


.161 


.992 


0.168 


167.50 


1.000 


.150 


.992 


0.160 


168.50 


1.000 


.147 


.992 


0.159 


169.50 


1.000 


.143 


.992 


0.157 


170.50 


1.000 


.140 


.992 


0.152 


171.50 


1.000 


.128 


.992 


0.141 


172.50 


1.000 


.126 


.992 


0.137 


173.50 


1.000 


.119 


.992 


0.134 


174.50 


1.000 


.115 


.992 


0.131 


175.50 


1.000 


.112 


.992 


0.128 


176.50 


1.000 


.109 


.992 


0.122 


177.50 


1.000 


.107 


.992 


0.118 


178.50 


1.000 


.097 


.992 


0.114 


179.50 


- 


- 


.992 


0.110 


180.00 


1.000 


.094 


- 


- 


180.50 


- 


- 


.992 


0.107 


181.50 


1.000 


.093 


.992 


0.103 


182.50 


1.000 


.090 


.992 


0.101 


183.50 


1.000 


.086 


.992 


0.093 
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Grade 3 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


184.50 


1.000 


.083 


.992 


0.089 


185.50 


1.000 


.082 


.992 


0.085 


186.50 


1.000 


.075 


.992 


0.080 


187.50 


- 


- 


.992 


0.076 


188.00 


1.000 


.065 


- 


- 


188.50 


- 


- 


.992 


0.073 


189.50 


1.000 


.063 


.992 


0.069 


190.50 


1.000 


.055 


.992 


0.062 


191.50 


1.000 


.054 


.992 


0.060 


193.00 


1.000 


.050 


.992 


0.058 


194.50 


1.000 


.047 


.992 


0.057 


195.50 


1.000 


.046 


1.000 


0.053 


196.50 


1.000 


.042 


1.000 


0.052 


197.50 


1.000 


.040 


1.000 


0.048 


198.50 


1.000 


.037 


- 


- 


199.00 


- 


- 


1.000 


0.040 


200.00 


1.000 


.036 


- 


- 


200.50 


- 


- 


1.000 


0.037 


201.50 


1.000 


.035 


1.000 


0.036 


202.50 


1.000 


.034 


1.000 


0.034 


203.50 


1.000 


.033 


1.000 


0.032 


204.50 


1.000 


.031 


- 


- 


206.00 


- 


- 


1.000 


0.031 


206.50 


1.000 


.029 


- 


- 


208.50 


- 


- 


1.000 


0.025 


209.50 


1.000 


.028 


- 


- 


210.50 


- 


- 


1.000 


0.024 


211.50 


1.000 


.027 


- 


- 


212.50 


1.000 


.026 


1.000 


0.022 


213.50 


1.000 


.020 


1.000 


0.018 


215.00 


- 


- 


1.000 


0.016 


215.50 


1.000 


.019 


- 


- 


217.00 


- 


- 


1.000 


0.015 


217.50 


1.000 


.018 


- 


- 


219.00 


1.000 


.017 


1.000 


0.014 


221.00 


- 


- 


1.000 


0.013 


222.50 


1.000 


.014 


- 


- 
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Grade 3 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


223.00 


- 


- 


1.000 


0.011 


224.50 


- 


- 


1.000 


0.010 


227.00 


- 


- 


1.000 


0.008 


228.00 


1.000 


.012 


- 


- 


230.00 


- 


- 


1.000 


0.005 


230.50 


1.000 


.011 


- 


- 


231.50 


1.000 


.010 


- 


- 


233.00 


1.000 


.009 


- 


- 


233.50 


- 


- 


1.000 


0.004 


235.00 


1.000 


.008 


- 


- 


237.50 


1.000 


.006 


- 


- 


239.00 


- 


- 


1.000 


0.002 


241.50 


1.000 


.005 


- 


- 


247.00 


1.000 


.004 


- 


- 


254.50 


1.000 


.003 


- 


- 


255.00 


- 


- 


1.000 


0.001 


259.50 


1.000 


.002 


- 


- 


269.00 


- 


- 


1.000 


0.000 


284.00 


1.000 


.001 


- 


- 


309.00 


1.000 


.000 


- 


- 
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Grade 3 

Winter MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


132 




Negative 


1067 




Missing 


745 


Group 2 


Positive 3 


128 




Negative 


1064 




Missing 


752 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): WintlOMCRC has at least one 
tie between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): WintlOMCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.789 


.018 


.000 


.753 .825 


Group 2 


.794 


.018 


.000 


.759 .829 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): WintlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): WintlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 3 

Winter MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.076 


.979 


.070 


.970 


1.50 


.076 


.978 


- 


- 


2.00 


- 


- 


.070 


.969 


2.50 


.083 


.977 


- 


- 


3.50 


.114 


.970 


.094 


.964 


4.50 


.167 


.959 


.117 


.956 


5.50 


.258 


.946 


.234 


.940 


6.50 


.379 


.909 


.359 


.894 


7.50 


.485 


.858 


.531 


.848 


8.50 


.591 


.775 


.680 


.779 


9.50 


.773 


.680 


.766 


.684 


10.50 


.902 


.558 


.883 


.573 


11.50 


.932 


.441 


.938 


.456 


12.50 


.970 


.297 


.969 


.306 


13.50 


.985 


.188 


.992 


.185 


14.50 


1.000 


.097 


1.000 


.093 


15.50 


1.000 


.040 


1.000 


.039 


16.50 


1.000 


.011 


1.000 


.009 


17.50 


1.000 


.001 


- 


- 


18.00 


- 


- 


1.000 


.000 


19.00 


1.000 


.000 


- 


- 
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Grade 3 

Spring PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


115 




Negative 


963 




Missing 


866 


Group 2 


Positive 3 


117 




Negative 


951 




Missing 


876 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOPRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOPRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.909 


.013 


.000 


.883 .934 


Group 2 


.898 


.014 


.000 


.871 .925 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOPRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOPRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 

Crossvalidation: Group 1 




ROC Curve 
Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 3 

Spring PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


2.00 


.000 


1.000 


- 


- 


7.00 


- 


- 


.000 


1.000 


7.50 


.009 


1.000 


- 


- 


8.50 


- 


- 


.009 


1.000 


10.50 


- 


- 


.017 


1.000 


13.50 


.017 


1.000 


- 


- 


14.50 


- 


- 


.026 


1.000 


16.00 


.026 


1.000 


- 


- 


18.00 


.035 


1.000 


.034 


1.000 


19.50 


.043 


1.000 


.043 


1.000 


20.50 


.052 


1.000 


.060 


1.000 


22.00 


.061 


1.000 


.077 


1.000 


23.50 


.070 


1.000 


.085 


1.000 


24.50 


- 


- 


.094 


1.000 


25.00 


.078 


1.000 


- 


- 


25.50 


- 


- 


.111 


1.000 


26.50 


- 


- 


.120 


1.000 


27.50 


.078 


.999 


- 


- 


28.00 


- 


- 


.128 


1.000 


30.00 


.096 


.999 


- 


- 


30.50 


- 


- 


.137 


1.000 


32.00 


.104 


.999 


- 


- 


33.00 


- 


- 


.145 


1.000 


33.50 


.113 


.999 


- 


- 


34.50 


.130 


.999 


.171 


1.000 


36.00 


- 


- 


.179 


1.000 


36.50 


.139 


.998 


- 




38.00 


- 


- 


.188 


1.000 


39.00 


.148 


.998 


- 


- 


39.50 


- 


- 


.205 


1.000 


40.50 


.165 


.997 


.214 


1.000 


41.50 


.165 


.996 


.222 


1.000 


42.50 


.183 


.995 


.231 


1.000 


43.50 


.191 


.995 


.239 


.998 


44.50 


- 


- 


.239 


.996 


45.00 


.200 


.995 


- 


- 


45.50 


- 


- 


.248 


.996 
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Grade 3 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


46.50 


- 


- 


.274 


.996 


47.00 


.217 


.994 


- 


- 


48.00 


- 


- 


.274 


.995 


49.00 


.243 


.992 


- 


- 


49.50 


- 


- 


.282 


.993 


50.50 


.261 


.991 


.291 


.993 


51.50 


.278 


.988 


.299 


.993 


52.50 


.287 


.988 


.299 


.991 


53.50 


.296 


.987 


.325 


.987 


54.50 


.330 


.984 


.325 


.984 


55.50 


.357 


.982 


.325 


.982 


56.50 


.374 


.978 


.342 


.977 


57.50 


.426 


.975 


.350 


.972 


58.50 


.443 


.974 


.368 


.964 


59.50 


.452 


.969 


.385 


.961 


60.50 


.487 


.968 


.385 


.958 


61.50 


.496 


.967 


.419 


.958 


62.50 


.513 


.966 


.419 


.953 


63.50 


.513 


.964 


.436 


.952 


64.50 


.539 


.956 


.436 


.950 


65.50 


.574 


.953 


.453 


.947 


66.50 


.574 


.948 


.470 


.944 


67.50 


.591 


.945 


.487 


.940 


68.50 


.600 


.943 


.487 


.932 


69.50 


.617 


.938 


.496 


.930 


70.50 


.635 


.935 


.530 


.926 


71.50 


.643 


.929 


.547 


.924 


72.50 


.670 


.926 


.581 


.921 


73.50 


.670 


.922 


.590 


.915 


74.50 


.687 


.918 


.624 


.913 


75.50 


.687 


.917 


.641 


.907 


76.50 


.713 


.914 


.650 


.904 


77.50 


.722 


.912 


.650 


.903 


78.50 


.730 


.908 


.667 


.900 


79.50 


.748 


.906 


.675 


.898 


80.50 


.757 


.896 


.692 


.894 


81.50 


.757 


.892 


.709 


.889 
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Grade 3 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


82.50 


.765 


.886 


.718 


.883 


83.50 


.765 


.884 


.744 


.875 


84.50 


.774 


.880 


.752 


.872 


85.50 


.774 


.876 


.786 


.864 


86.50 


.774 


.872 


.803 


.859 


87.50 


.783 


.862 


.812 


.849 


88.50 


.783 


.850 


.838 


.841 


89.50 


.791 


.839 


.855 


.833 


90.50 


.800 


.826 


.855 


.815 


91.50 


.809 


.819 


.863 


.802 


92.50 


.826 


.811 


.872 


.792 


93.50 


.826 


.806 


.872 


.782 


94.50 


.835 


.790 


.872 


.775 


95.50 


.843 


.779 


.880 


.764 


96.50 


.861 


.765 


.880 


.750 


97.50 


.878 


.754 


.880 


.740 


98.50 


.878 


.742 


.880 


.727 


99.50 


.887 


.729 


.880 


.714 


100.50 


.904 


.722 


.880 


.710 


101.50 


.904 


.715 


.897 


.706 


102.50 


.904 


.713 


.897 


.700 


103.50 


.904 


.705 


.897 


.696 


104.50 


.904 


.696 


.897 


.689 


105.50 


.913 


.688 


.897 


.681 


106.50 


.930 


.673 


.897 


.669 


107.50 


.939 


.658 


.906 


.652 


108.50 


.939 


.644 


.923 


.635 


109.50 


.939 


.632 


.940 


.624 


110.50 


.965 


.627 


.949 


.616 


111.50 


.965 


.621 


.957 


.601 


112.50 


.965 


.613 


.957 


.591 


113.50 


.965 


.605 


.966 


.580 


114.50 


.965 


.595 


.966 


.570 


115.50 


.965 


.585 


.966 


.563 


116.50 


.965 


.578 


.966 


.545 


117.50 


.974 


.561 


.966 


.536 


118.50 


.983 


.536 


.966 


.526 
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Grade 3 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


119.50 


.983 


.532 


.966 


.519 


120.50 


.983 


.528 


.966 


.516 


121.50 


.983 


.514 


.966 


.508 


122.50 


.983 


.502 


.974 


.502 


123.50 


.983 


.492 


.983 


.493 


124.50 


.983 


.482 


.991 


.481 


125.50 


.991 


.472 


.991 


.475 


126.50 


.991 


.464 


.991 


.466 


127.50 


.991 


.454 


.991 


.458 


128.50 


.991 


.445 


.991 


.448 


129.50 


.991 


.425 


.991 


.426 


130.50 


.991 


.417 


.991 


.421 


131.50 


.991 


.406 


.991 


.411 


132.50 


.991 


.397 


.991 


.404 


133.50 


.991 


.391 


.991 


.394 


134.50 


.991 


.380 


.991 


.387 


135.50 


.991 


.373 


.991 


.373 


136.50 


.991 


.366 


.991 


.365 


137.50 


.991 


.354 


.991 


.352 


138.50 


.991 


.344 


.991 


.346 


139.50 


.991 


.334 


.991 


.340 


140.50 


.991 


.315 


.991 


.323 


141.50 


.991 


.308 


.991 


.318 


142.50 


.991 


.300 


.991 


.307 


143.50 


.991 


.290 


.991 


.294 


144.50 


1.000 


.290 


.991 


.292 


145.50 


1.000 


.282 


.991 


.291 


146.50 


1.000 


.279 


.991 


.286 


147.50 


1.000 


.272 


.991 


.279 


148.50 


1.000 


.268 


.991 


.270 


149.50 


1.000 


.263 


.991 


.263 


150.50 


1.000 


.254 


.991 


.254 


151.50 


1.000 


.238 


.991 


.238 


152.50 


1.000 


.228 


.991 


.233 


153.50 


1.000 


.215 


.991 


.228 


154.50 


1.000 


.210 


.991 


.223 


155.50 


1.000 


.204 


.991 


.221 
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Grade 3 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


156.50 


1.000 


.201 


.991 


.213 


157.50 


1.000 


.196 


.991 


.212 


158.50 


1.000 


.191 


.991 


.208 


159.50 


1.000 


.186 


.991 


.203 


160.50 


1.000 


.181 


.991 


.193 


161.50 


1.000 


.180 


.991 


.188 


162.50 


1.000 


.179 


.991 


.187 


163.50 


1.000 


.172 


.991 


.181 


164.50 


1.000 


.169 


1.000 


.175 


165.50 


1.000 


.164 


1.000 


.169 


166.50 


1.000 


.151 


1.000 


.159 


167.50 


1.000 


.147 


1.000 


.154 


168.50 


1.000 


.141 


1.000 


.145 


169.50 


1.000 


.139 


1.000 


.139 


170.50 


1.000 


.133 


1.000 


.137 


171.50 


1.000 


.131 


1.000 


.130 


172.50 


1.000 


.127 


1.000 


.128 


173.50 


1.000 


.123 


1.000 


.120 


174.50 


1.000 


.117 


1.000 


.118 


175.50 


1.000 


.115 


1.000 


.114 


176.50 


1.000 


.109 


1.000 


.105 


177.50 


1.000 


.107 


1.000 


.104 


178.50 


1.000 


.104 


1.000 


.101 


179.50 


1.000 


.101 


1.000 


.099 


180.50 


1.000 


.096 


1.000 


.096 


181.50 


1.000 


.090 


1.000 


.093 


182.50 


1.000 


.082 


1.000 


.091 


183.50 


1.000 


.078 


1.000 


.084 


184.50 


1.000 


.077 


1.000 


.082 


185.50 


1.000 


.075 


1.000 


.080 


186.50 


1.000 


.074 


1.000 


.073 


187.50 


1.000 


.073 


1.000 


.070 


188.50 


1.000 


.069 


1.000 


.067 


189.50 


- 


- 


1.000 


.065 


190.00 


1.000 


.063 


- 


- 


190.50 


- 


- 


1.000 


.062 


191.50 


- 


- 


1.000 


.060 
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Grade 3 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


192.50 


1.000 


.059 


- 


- 


193.00 


- 


- 


1.000 


.056 


194.50 


1.000 


.057 


1.000 


.054 


195.50 


1.000 


.053 


1.000 


.050 


196.50 


- 


- 


1.000 


.045 


197.00 


1.000 


.050 


- 


- 


197.50 


- 


- 


1.000 


.044 


198.50 


1.000 


.048 


1.000 


.043 


199.50 


1.000 


.046 


1.000 


.040 


200.50 


1.000 


.043 


1.000 


.033 


201.50 


1.000 


.040 


- 


- 


202.00 


- 


- 


1.000 


.032 


202.50 


1.000 


.038 


- 


- 


203.50 


1.000 


.036 


1.000 


.030 


204.50 


1.000 


.035 


1.000 


.028 


205.50 


1.000 


.030 


1.000 


.026 


206.50 


1.000 


.029 


1.000 


.025 


207.50 


1.000 


.028 


1.000 


.023 


208.50 


1.000 


.026 


1.000 


.022 


209.50 


1.000 


.025 


1.000 


.021 


211.50 


- 


- 


1.000 


.019 


212.00 


1.000 


.024 


- 


- 


213.50 


- 


- 


1.000 


.018 


214.50 


1.000 


.023 


1.000 


.017 


215.50 


1.000 


.019 


- 


- 


216.50 


1.000 


.018 


1.000 


.016 


217.50 


1.000 


.017 


- 


- 


218.50 


1.000 


.016 


- 


- 


219.00 


- 


- 


1.000 


.015 


219.50 


1.000 


.015 


- 


- 


221.00 


- 


- 


1.000 


.014 


221.50 


1.000 


.013 


- 


- 


223.00 


- 


- 


1.000 


.012 


223.50 


1.000 


.012 


- 


- 


224.50 


- 


- 


1.000 


.011 


225.50 


- 


- 


1.000 


.008 


226.50 


1.000 


.011 


- 


- 
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Grade 3 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


228.50 


- 


- 


1.000 


.007 


231.50 


1.000 


.009 


- 


- 


232.00 


- 


- 


1.000 


.006 


234.00 


- 


- 


1.000 


.005 


235.00 


1.000 


.008 


- 


- 


238.00 


1.000 


.007 


- 


- 


241.00 


- 


- 


1.000 


.004 


241.50 


1.000 


.005 


- 


- 


246.00 


1.000 


.004 


- 


- 


249.00 


- 


- 


1.000 


.003 


250.00 


1.000 


.003 


1.000 


.002 


252.50 


1.000 


.002 


- 


- 


254.50 


1.000 


.001 


- 


- 


256.00 


1.000 


.000 


- 


- 


259.50 


- 


- 


1.000 


.001 


267.00 


- 


- 


1.000 


.000 






Cross Validation: Oregon 



Appendix B 



p. 100 



Grade 3 

Spring MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


125 




Negative 


1045 




Missing 


774 


Group 2 


Positive 3 


123 




Negative 


1021 




Missing 





Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOMCRC has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOMCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.851 


.016 


.000 


.820 .882 


Group 2 


.859 


.017 


.000 


.826 .891 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 







Cross Validation: Oregon 



Appendix B 



p. 101 



ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 





Cross Validation: Oregon 



Appendix B 



p. 102 



Grade 3 

Spring MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.040 


.984 


.033 


.983 


1.50 


.048 


.983 


.033 


.982 


2.50 


.048 


.982 


.041 


.981 


3.50 


.072 


.981 


.065 


.979 


4.50 


.088 


.979 


.106 


.976 


5.50 


.152 


.968 


.163 


.970 


6.50 


.240 


.955 


.252 


.959 


7.50 


.368 


.927 


.415 


.934 


8.50 


.504 


.902 


.528 


.910 


9.50 


.640 


.877 


.659 


.874 


10.50 


.704 


.829 


.724 


.826 


11.50 


.816 


.780 


.846 


.784 


12.50 


.848 


.724 


.894 


.727 


13.50 


.904 


.664 


.919 


.653 


14.50 


.936 


.565 


.943 


.575 


15.50 


.968 


.463 


.951 


.473 


16.50 


.984 


.334 


.959 


.335 


17.50 


.984 


.204 


.984 


.198 


18.50 


.992 


.088 


1.000 


.090 


19.50 


1.000 


.023 


1.000 


.019 


21.00 


1.000 


.000 


1.000 


.000 
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Grade 3 

Spring VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


116 




Negative 


941 




Missing 


887 


Group 2 


Positive 3 


112 




Negative 


920 




Missing 


912 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOVoc has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOVoc 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.926 




.000 


.902 .950 


Group 2 


.939 




.000 


.922 .956 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOVoc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOVoc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 

Crossvalidation: Group 1 




ROC Curve 




Diagonal segments are produced by ties. 
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Grade 3 

Spring VQC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


- 


- 


.000 


.999 


2.00 


- 


- 


.000 


.997 


2.50 


.017 


.998 


- 


- 


4.00 


- 


- 


.000 


.996 


5.50 


.034 


.998 


.018 


.996 


6.50 


.052 


.998 


.045 


.996 


7.50 


.069 


.998 


.071 


.996 


8.50 


.138 


.998 


.107 


.995 


9.50 


.164 


.997 


.143 


.995 


10.50 


.207 


.995 


.188 


.993 


11.50 


.224 


.993 


.286 


.993 


12.50 


.276 


.989 


.348 


.990 


13.50 


.379 


.982 


.393 


.986 


14.50 


.422 


.973 


.420 


.979 


15.50 


.500 


.965 


.464 


.973 


16.50 


.595 


.956 


.554 


.961 


17.50 


.655 


.949 


.652 


.946 


18.50 


.767 


.926 


.768 


.918 


19.50 


.793 


.889 


.839 


.879 


20.50 


.853 


.830 


.902 


.830 


21.50 


.957 


.740 


.955 


.743 


22.50 


.983 


.631 


1.000 


.635 


23.50 


.983 


.470 


1.000 


.493 


24.50 


.991 


.252 


1.000 


.260 


26.00 


1.000 


.000 


1.000 


.000 
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Grade 4 

Fall PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


120 




Negative 


982 




Missing 


768 


Group 2 


Positive 3 


111 




Negative 


998 




Missing 


761 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09PRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09PRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.878 


.015 


.000 


.849 .908 


Group 2 


.856 


.018 


.000 


.822 .891 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09PRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09PRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 4 

Fall PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


3.00 


.000 


1.000 


- 


- 


8.00 


.008 


1.000 


.000 


1.000 


12.00 


- 


- 


.009 


1.000 


12.50 


.017 


1.000 


- 


- 


15.50 


.025 


1.000 


.027 


1.000 


17.00 


- 


- 


.036 


1.000 


18.50 


- 


- 


.045 


1.000 


19.00 


.033 


1.000 


- 


- 


20.00 


- 


- 


.054 


1.000 


22.00 


.042 


.999 


- 


- 


22.50 


- 


- 


.063 


1.000 


25.00 


.042 


.998 


.072 


.999 


26.50 


.050 


.998 


.081 


.999 


28.00 


.058 


.998 


- 


- 


28.50 


- 


- 


.081 


.998 


30.00 


.067 


.998 


- 


- 


31.00 


- 


- 


.099 


.997 


34.00 


.083 


.997 


- 


- 


34.50 


- 


- 


.117 


.994 


37.50 


- 


- 


.126 


.994 


38.00 


.092 


.997 


- 


- 


39.00 


- 


- 


.135 


.994 


39.50 


.108 


.997 


- 


- 


40.50 


.133 


.997 


.135 


.992 


41.50 


.150 


.995 


- 


- 


42.00 


- 


- 


.135 


.990 


42.50 


.158 


.995 


- 


- 


43.50 


.183 


.995 


.144 


.989 


44.50 


.200 


.995 


.153 


.989 


45.50 


.225 


.994 


- 


- 


46.00 


- 


- 


.162 


.989 


46.50 


.242 


.994 


- 


- 


47.50 


.275 


.994 


.162 


.988 


48.50 


.283 


.993 


- 


- 


49.00 


- 


- 


.171 


.986 


49.50 


.300 


.993 


- 


- 


50.50 


- 


- 


.198 


.985 
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Grade 4 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


51.00 


.308 


.993 


- 


- 


51.50 


- 


- 


.216 


.984 


52.50 


.308 


.991 


.216 


.980 


53.50 


.317 


.991 


.234 


.977 


54.50 


.325 


.989 


.252 


.976 


55.50 


.342 


.989 


.252 


.975 


56.50 


.358 


.986 


.261 


.974 


57.50 


.367 


.984 


.270 


.972 


58.50 


.375 


.983 


- 


- 


59.00 


- 


- 


.306 


.971 


59.50 


.375 


.979 


- 


- 


60.50 


.383 


.979 


.324 


.969 


61.50 


.433 


.979 


.324 


.965 


62.50 


.442 


.977 


.342 


.962 


63.50 


.450 


.976 


.351 


.960 


64.50 


.458 


.968 


.360 


.957 


65.50 


.458 


.966 


.378 


.955 


66.50 


.458 


.961 


.396 


.950 


67.50 


.483 


.958 


.396 


.946 


68.50 


.483 


.954 


.423 


.945 


69.50 


.500 


.948 


.423 


.941 


70.50 


.517 


.945 


.450 


.937 


71.50 


.525 


.938 


.477 


.936 


72.50 


.542 


.933 


.495 


.930 


73.50 


.550 


.926 


.523 


.927 


74.50 


.567 


.920 


.523 


.924 


75.50 


.600 


.912 


.532 


.920 


76.50 


.600 


.908 


.559 


.909 


77.50 


.608 


.902 


.595 


.906 


78.50 


.617 


.895 


.604 


.900 


79.50 


.617 


.890 


.613 


.892 


80.50 


.658 


.878 


.622 


.885 


81.50 


.675 


.865 


.631 


.878 


82.50 


.683 


.854 


.640 


.872 


83.50 


.692 


.841 


.649 


.863 


84.50 


.700 


.831 


.694 


.856 


85.50 


.717 


.820 


.703 


.851 
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Grade 4 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


86.50 


.733 


.804 


.721 


.834 


87.50 


.758 


.782 


.721 


.816 


88.50 


.775 


.763 


.730 


.798 


89.50 


.792 


.751 


.766 


.781 


90.50 


.825 


.743 


.784 


.770 


91.50 


.842 


.738 


.802 


.759 


92.50 


.842 


.727 


.802 


.751 


93.50 


.858 


.718 


.811 


.739 


94.50 


.867 


.707 


.820 


.732 


95.50 


.875 


.692 


.829 


.716 


96.50 


.883 


.682 


.829 


.709 


97.50 


.892 


.670 


.838 


.694 


98.50 


.892 


.659 


.847 


.685 


99.50 


.892 


.652 


.865 


.675 


100.50 


.900 


.630 


.883 


.662 


101.50 


.917 


.628 


.892 


.648 


102.50 


.942 


.613 


.901 


.629 


103.50 


.950 


.598 


.901 


.611 


104.50 


.950 


.580 


.910 


.586 


105.50 


.950 


.568 


.910 


.567 


106.50 


.950 


.557 


.919 


.558 


107.50 


.950 


.545 


.919 


.546 


108.50 


.958 


.533 


.928 


.537 


109.50 


.958 


.520 


.937 


.527 


110.50 


.967 


.511 


.937 


.519 


111.50 


.967 


.507 


.937 


.508 


112.50 


.975 


.497 


.937 


.493 


113.50 


.983 


.484 


.937 


.480 


114.50 


.983 


.473 


.937 


.472 


115.50 


.983 


.453 


.946 


.455 


116.50 


.992 


.437 


.946 


.439 


117.50 


.992 


.419 


.955 


.423 


118.50 


.992 


.399 


.964 


.409 


119.50 


.992 


.390 


.973 


.390 


120.50 


.992 


.384 


.973 


.375 


121.50 


.992 


.373 


.973 


.361 


122.50 


.992 


.367 


.973 


.354 
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Grade 4 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


123.50 


.992 


.355 


.973 


.346 


124.50 


.992 


.346 


.973 


.338 


125.50 


.992 


.340 


.982 


.322 


126.50 


.992 


.331 


.982 


.311 


127.50 


.992 


.323 


.982 


.303 


128.50 


.992 


.317 


.982 


.297 


129.50 


.992 


.302 


.982 


.287 


130.50 


.992 


.293 


.982 


.279 


131.50 


.992 


.285 


.982 


.273 


132.50 


.992 


.280 


.982 


.268 


133.50 


.992 


.272 


.991 


.259 


134.50 


.992 


.261 


.991 


.253 


135.50 


.992 


.253 


.991 


.246 


136.50 


.992 


.247 


.991 


.238 


137.50 


.992 


.241 


.991 


.232 


138.50 


.992 


.234 


.991 


.231 


139.50 


.992 


.226 


.991 


.225 


140.50 


.992 


.221 


.991 


.215 


141.50 


.992 


.206 


.991 


.203 


142.50 


.992 


.201 


.991 


.196 


143.50 


.992 


.192 


.991 


.191 


144.50 


.992 


.190 


.991 


.184 


145.50 


.992 


.183 


.991 


.174 


146.50 


.992 


.178 


.991 


.167 


147.50 


.992 


.175 


.991 


.157 


148.50 


.992 


.168 


1.000 


.147 


149.50 


.992 


.165 


1.000 


.143 


150.50 


.992 


.162 


1.000 


.139 


151.50 


1.000 


.157 


1.000 


.134 


152.50 


1.000 


.152 


1.000 


.123 


153.50 


1.000 


.147 


1.000 


.119 


154.50 


1.000 


.145 


1.000 


.117 


155.50 


1.000 


.142 


1.000 


.115 


156.50 


1.000 


.137 


1.000 


.112 


157.50 


1.000 


.136 


1.000 


.109 


158.50 


1.000 


.129 


1.000 


.106 


159.50 


1.000 


.121 


1.000 


.103 
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Grade 4 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


160.50 


1.000 


.118 


1.000 


.101 


161.50 


1.000 


.117 


1.000 


.097 


162.50 


1.000 


.115 


1.000 


.096 


163.50 


1.000 


.111 


1.000 


.092 


165.00 


1.000 


.109 


1.000 


.087 


166.50 


1.000 


.105 


1.000 


.083 


167.50 


1.000 


.098 


1.000 


.078 


168.50 


1.000 


.093 


1.000 


.075 


169.50 


1.000 


.086 


1.000 


.070 


170.50 


1.000 


.077 


1.000 


.066 


171.50 


1.000 


.075 


1.000 


.063 


172.50 


1.000 


.074 


1.000 


.060 


173.50 


1.000 


.071 


1.000 


.058 


174.50 


1.000 


.065 


1.000 


.052 


175.50 


1.000 


.058 


1.000 


.049 


176.50 


- 


- 


1.000 


.046 


177.00 


1.000 


.056 


- 


- 


177.50 


- 


- 


1.000 


.044 


178.50 


1.000 


.051 


1.000 


.043 


179.50 


1.000 


.048 


1.000 


.040 


180.50 


- 


- 


1.000 


.038 


181.50 


1.000 


.039 


1.000 


.037 


182.50 


- 


- 


1.000 


.035 


183.50 


1.000 


.037 


1.000 


.031 


184.50 


1.000 


.036 


- 


- 


185.00 


- 


- 


1.000 


.030 


185.50 


1.000 


.034 


- 


- 


186.50 


1.000 


.033 


1.000 


.029 


187.50 


- 


- 


1.000 


.027 


188.00 


1.000 


.032 


- 


- 


188.50 


- 


- 


1.000 


.026 


189.50 


1.000 


.029 


- 


- 


190.50 


1.000 


.027 


- 


- 


191.50 


1.000 


.026 


1.000 


.024 


193.00 


1.000 


.025 


- 


- 


194.50 


- 


- 


1.000 


.021 
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Grade 4 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


195.00 


1.000 


.024 


- 


- 


195.50 


- 


- 


1.000 


.019 


196.50 


1.000 


.022 


- 


- 


197.00 


- 


- 


1.000 


.018 


198.00 


1.000 


.021 


- 


- 


198.50 


- 


- 


1.000 


.017 


200.00 


1.000 


.019 


1.000 


.016 


201.50 


- 


- 


1.000 


.015 


202.00 


1.000 


.018 


- 


- 


203.00 


- 


- 


1.000 


.014 


203.50 


1.000 


.017 


- 


- 


204.50 


- 


- 


1.000 


.013 


205.50 


1.000 


.016 


- 


- 


207.00 


- 


- 


1.000 


.012 


208.00 


1.000 


.013 


- 


- 


209.50 


- 


- 


1.000 


.011 


210.00 


1.000 


.011 


- 


- 


211.50 


1.000 


.010 


1.000 


.010 


212.00 


- 


- 


1.000 


.010 


214.50 


1.000 


.009 


- 


- 


215.00 


- 


- 


1.000 


.008 


217.50 


1.000 


.008 


1.000 


.007 


222.00 


1.000 


.007 


1.000 


.006 


226.50 


- 


- 


1.000 


.005 


228.00 


1.000 


.006 


- 


- 


228.50 


- 


- 


1.000 


.004 


232.50 


- 


- 


1.000 


.002 


234.00 


1.000 


.005 


- 


- 


240.00 


1.000 


.004 


- 


- 


244.50 


1.000 


.003 


- 


- 


245.00 


- 


- 


1.000 


.001 


251.50 


1.000 


.002 


- 


- 


255.00 


- 


- 


1.000 


.000 


259.50 


1.000 


.001 


- 


- 


264.00 


1.000 


.000 


- 


- 
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Grade 4 

Fall MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


116 




Negative 


1010 




Missing 


744 


Group 2 


Positive 3 


117 




Negative 


1001 




Missing 


752 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09MCRC has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09MCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.845 


.014 


.000 


.817 .873 


Group 2 


.868 


.014 


.000 


.841 .896 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09MCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09MCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 4 

Fall MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.043 


.983 


.085 


.993 


1.50 


- 


- 


.094 


.990 


2.00 


.052 


.982 


- 


- 


2.50 


- 


- 


.111 


.988 


3.50 


.060 


.978 


.145 


.986 


4.50 


.138 


.966 


.197 


.983 


5.50 


.216 


.951 


.291 


.959 


6.50 


.353 


.922 


.402 


.924 


7.50 


.534 


.874 


.590 


.883 


8.50 


.690 


.817 


.726 


.826 


9.50 


.810 


.742 


.829 


.782 


10.50 


.897 


.662 


.897 


.705 


11.50 


.940 


.589 


.932 


.633 


12.50 


.966 


.524 


.957 


.561 


13.50 


1.000 


.452 


.974 


.484 


14.50 


1.000 


.365 


.991 


.395 


15.50 


1.000 


.274 


1.000 


.298 


16.50 


1.000 


.184 


1.000 


.225 


17.50 


1.000 


.113 


1.000 


.130 


18.50 


1.000 


.043 


1.000 


.055 


19.50 


1.000 


.010 


1.000 


.020 


21.00 


1.000 


.000 


1.000 


.000 
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Grade 4 

Fall VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


105 




Negative 


873 




Missing 


892 


Group 2 


Positive 3 


95 




Negative 


880 




Missing 


895 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09Voc has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09Voc 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.894 


.014 


.000 


.866 .921 


Group 2 


.905 


.014 


.000 


.878 .933 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09Voc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09Voc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 4 

Fall VOC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.000 


.998 


.000 


.999 


2.00 


.000 


.995 


- 


- 


3.50 


.010 


.995 


.021 


.999 


4.50 


.029 


.995 


.042 


.998 


5.50 


.086 


.994 


.074 


.997 


6.50 


.133 


.991 


.168 


.994 


7.50 


.248 


.978 


.305 


.983 


8.50 


.324 


.971 


.368 


.970 


9.50 


.467 


.951 


.463 


.955 


10.50 


.590 


.919 


.600 


.932 


11.50 


.714 


.882 


.695 


.894 


12.50 


.800 


.838 


.747 


.866 


13.50 


.867 


.769 


.863 


.808 


14.50 


.924 


.699 


.926 


.749 


15.50 


.943 


.621 


.947 


.660 


16.50 


.971 


.537 


.979 


.568 


17.50 


.981 


.454 


.989 


.476 


18.50 


.990 


.369 


.989 


.383 


19.50 


1.000 


.276 


.989 


.285 


20.50 


1.000 


.198 


.989 


.193 


21.50 


1.000 


.118 


1.000 


.140 


22.50 


1.000 


.058 


1.000 


.072 


23.50 


1.000 


.032 


1.000 


.027 


24.50 


1.000 


.008 


1.000 


.010 


26.00 


1.000 


.000 


1.000 


.000 
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Grade 4 

Winter PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


112 




Negative 


972 




Missing 


786 


Group 2 


Positive 3 


106 




Negative 


973 




Missing 


791 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): WintlOPRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): WintlOPRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.884 


.017 


.000 


.851 .917 


Group 2 


.889 


.017 


.000 


.855 .923 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): WintlOPRF has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): WintlOPRF has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 
Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 4 

Winter PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


5.00 


.000 


1.000 


- 


- 


12.00 


- 


- 


.000 


1.000 


13.50 


- 


- 


.000 


.999 


14.50 


- 


- 


.009 


.999 


15.50 


.009 


1.000 


- 


- 


23.00 


- 


- 


.019 


.999 


28.00 


.018 


1.000 


- 


- 


32.00 


- 


- 


.028 


.999 


34.00 


- 


- 


.038 


.999 


35.50 


.027 


1.000 


- 


- 


36.00 


- 


- 


.047 


.999 


38.00 


- 


- 


.057 


.999 


40.00 


- 


- 


.075 


.999 


40.50 


.036 


1.000 


- 


- 


41.50 


- 


- 


.085 


.999 


42.00 


.045 


1.000 


- 


- 


44.00 


.054 


1.000 


.085 


.998 


47.50 


.063 


.999 


.104 


.997 


49.50 


- 


- 


.113 


.997 


50.50 


.080 


.999 


.123 


.997 


52.00 


.098 


.999 


- 


- 


52.50 


- 


- 


.132 


.996 


53.50 


.107 


.999 


- 


- 


54.50 


.134 


.999 


- 


- 


55.50 


.143 


.999 


.142 


.996 


56.50 


.152 


.999 


- 


- 


57.50 


.170 


.998 


- 


- 


58.00 


- 


- 


.151 


.995 


58.50 


.188 


.997 


- 


- 


59.50 


- 


- 


.151 


.993 


60.00 


.223 


.995 


- 


- 


60.50 


- 


- 


.160 


.993 


61.50 


.259 


.994 


.170 


.993 


62.50 


- 


- 


.189 


.993 


63.00 


.286 


.992 


- 


- 


63.50 


- 


- 


.208 


.991 


64.50 


.286 


.991 


.236 


.989 
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Grade 4 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


65.50 


.295 


.990 


.264 


.982 


66.50 


.330 


.990 


- 


- 


67.00 


- 


- 


.274 


.980 


67.50 


.339 


.990 


- 


- 


68.50 


.348 


.986 


.292 


.979 


69.50 


.366 


.984 


.311 


.977 


70.50 


.375 


.984 


.330 


.976 


71.50 


.393 


.984 


.340 


.976 


73.00 


.402 


.981 


.340 


.972 


74.50 


.402 


.980 


.340 


.969 


75.50 


.402 


.978 


.340 


.968 


76.50 


.402 


.975 


.349 


.965 


77.50 


.411 


.974 


.368 


.964 


78.50 


.420 


.972 


.368 


.963 


79.50 


.438 


.970 


.387 


.962 


80.50 


.473 


.968 


.425 


.957 


81.50 


.482 


.965 


.434 


.955 


82.50 


.500 


.963 


.434 


.953 


83.50 


.500 


.960 


.434 


.952 


84.50 


.509 


.958 


.453 


.952 


85.50 


.527 


.955 


- 


- 


86.00 


- 


- 


.472 


.951 


86.50 


.545 


.952 


- 


- 


87.50 


.554 


.951 


.472 


.948 


88.50 


.563 


.950 


.481 


.945 


89.50 


.598 


.943 


.481 


.940 


90.50 


.598 


.936 


.491 


.937 


91.50 


.607 


.932 


.491 


.935 


92.50 


.607 


.930 


.500 


.932 


93.50 


.616 


.923 


.528 


.927 


94.50 


.625 


.916 


.575 


.926 


95.50 


.634 


.912 


.594 


.920 


96.50 


.634 


.906 


.623 


.916 


97.50 


.652 


.902 


.632 


.913 


98.50 


.661 


.892 


.642 


.903 


99.50 


.688 


.885 


.679 


.900 


100.50 


.696 


.881 


.698 


.895 
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Grade 4 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


101.50 


.696 


.877 


.717 


.892 


102.50 


.696 


.870 


.774 


.890 


103.50 


.714 


.864 


.802 


.882 


104.50 


.732 


.854 


.811 


.874 


105.50 


.750 


.838 


.821 


.865 


106.50 


.759 


.832 


.830 


.858 


107.50 


.759 


.829 


.840 


.852 


108.50 


.759 


.821 


.840 


.843 


109.50 


.768 


.809 


.849 


.831 


110.50 


.786 


.796 


.849 


.823 


111.50 


.813 


.786 


.849 


.813 


112.50 


.821 


.778 


.849 


.811 


113.50 


.839 


.769 


.858 


.804 


114.50 


.848 


.759 


.858 


.798 


115.50 


.848 


.747 


.868 


.781 


116.50 


.866 


.741 


.868 


.776 


117.50 


.884 


.733 


.868 


.767 


118.50 


.893 


.715 


.868 


.757 


119.50 


.893 


.698 


.877 


.747 


120.50 


.893 


.684 


.896 


.732 


121.50 


.893 


.673 


.906 


.716 


122.50 


.893 


.667 


.906 


.706 


123.50 


.893 


.651 


.915 


.691 


124.50 


.902 


.638 


.915 


.676 


125.50 


.911 


.628 


.915 


.667 


126.50 


.920 


.620 


.925 


.659 


127.50 


.929 


.609 


.934 


.647 


128.50 


.929 


.601 


.934 


.636 


129.50 


.929 


.593 


.934 


.626 


130.50 


.929 


.579 


.943 


.610 


131.50 


.938 


.566 


.943 


.599 


132.50 


.938 


.556 


.943 


.585 


133.50 


.938 


.548 


.943 


.577 


134.50 


.938 


.537 


.943 


.562 


135.50 


.946 


.525 


.943 


.547 


136.50 


.946 


.517 


.943 


.528 


137.50 


.955 


.498 


.953 


.518 
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Grade 4 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


138.50 


.955 


.474 


.953 


.494 


139.50 


.955 


.468 


.953 


.489 


140.50 


.964 


.455 


.953 


.482 


141.50 


.964 


.444 


.953 


.466 


142.50 


.964 


.440 


.953 


.462 


143.50 


.964 


.426 


.953 


.446 


144.50 


.964 


.412 


.953 


.432 


145.50 


.973 


.389 


.953 


.411 


146.50 


.973 


.381 


.953 


.401 


147.50 


.973 


.377 


.953 


.392 


148.50 


.973 


.370 


.953 


.382 


149.50 


.973 


.348 


.962 


.363 


150.50 


.973 


.345 


.962 


.353 


151.50 


.973 


.328 


.962 


.345 


152.50 


.973 


.318 


.962 


.337 


153.50 


.973 


.314 


.962 


.325 


154.50 


.982 


.293 


.972 


.313 


155.50 


.982 


.281 


.972 


.305 


156.50 


.982 


.271 


.972 


.293 


157.50 


.982 


.263 


.972 


.286 


158.50 


.991 


.256 


.972 


.273 


159.50 


.991 


.249 


.972 


.262 


160.50 


.991 


.246 


.972 


.257 


161.50 


.991 


.239 


.972 


.251 


162.50 


.991 


.236 


.972 


.238 


163.50 


.991 


.221 


.972 


.228 


164.50 


.991 


.201 


.972 


.209 


165.50 


.991 


.192 


.972 


.203 


166.50 


.991 


.186 


.972 


.196 


167.50 


.991 


.176 


.981 


.191 


168.50 


.991 


.160 


.981 


.180 


169.50 


.991 


.155 


.991 


.175 


170.50 


.991 


.147 


1.000 


.163 


171.50 


.991 


.143 


1.000 


.153 


172.50 


.991 


.137 


1.000 


.147 


173.50 


.991 


.132 


1.000 


.146 


174.50 


.991 


.128 


1.000 


.140 
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Grade 4 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


175.50 


1.000 


.123 


1.000 


.132 


176.50 


1.000 


.116 


1.000 


.126 


178.00 


1.000 


.111 


1.000 


.122 


179.50 


1.000 


.107 


1.000 


.117 


180.50 


1.000 


.101 


1.000 


.115 


181.50 


1.000 


.091 


1.000 


.112 


182.50 


1.000 


.085 


1.000 


.101 


183.50 


1.000 


.082 


1.000 


.099 


184.50 


1.000 


.080 


1.000 


.092 


185.50 


1.000 


.073 


1.000 


.088 


186.50 


1.000 


.068 


1.000 


.083 


187.50 


1.000 


.063 


1.000 


.081 


188.50 


1.000 


.061 


1.000 


.078 


189.50 


1.000 


.060 


- 


- 


190.00 


- 


- 


1.000 


.076 


190.50 


1.000 


.057 


- 


- 


191.50 


1.000 


.056 


1.000 


.074 


192.50 


1.000 


.052 


1.000 


.069 


193.50 


1.000 


.050 


1.000 


.066 


194.50 


1.000 


.049 


1.000 


.060 


195.50 


1.000 


.046 


1.000 


.050 


196.50 


1.000 


.045 


1.000 


.049 


197.50 


- 


- 


1.000 


.047 


198.00 


1.000 


.044 


- 


- 


198.50 


- 


- 


1.000 


.045 


199.50 


1.000 


.042 


1.000 


.044 


200.50 


1.000 


.038 


1.000 


.043 


201.50 


1.000 


.035 


1.000 


.038 


202.50 


1.000 


.034 


1.000 


.037 


203.50 


1.000 


.032 


1.000 


.036 


204.50 


1.000 


.030 


1.000 


.033 


205.50 


1.000 


.028 


1.000 


.031 


206.50 


1.000 


.026 


1.000 


.029 


208.00 


1.000 


.025 


- 


- 


209.50 


1.000 


.023 


1.000 


.028 


212.50 


1.000 


.022 


1.000 


.027 


213.50 


- 


- 


1.000 


.024 
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Grade 4 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


215.50 


1.000 


.020 


1.000 


.023 


217.00 


1.000 


.019 


1.000 


.022 


218.50 


- 


- 


1.000 


.021 


219.00 


1.000 


.017 


- 


- 


223.00 


1.000 


.016 


1.000 


.020 


226.50 


1.000 


.015 


- 


- 


227.50 


1.000 


.014 


1.000 


.017 


228.50 


1.000 


.012 


- 


- 


230.00 


- 


- 


1.000 


.016 


230.50 


1.000 


.011 


- 


- 


232.50 


1.000 




1.000 


.015 


234.50 


- 


- 


1.000 


.013 


235.50 


1.000 


.009 


- 


- 


236.50 


- 


- 


1.000 


.010 


238.50 


- 


- 


1.000 


.008 


240.00 


1.000 


.007 


- 


- 


242.00 


- 


- 


1.000 


.007 


244.50 


1.000 


.006 


1.000 


.006 


247.00 


- 


- 


1.000 


.005 


248.00 


1.000 


.005 


- 


- 


249.50 


- 


- 


1.000 


.004 


250.50 


1.000 


.004 


- 


- 


252.00 


- 


- 


1.000 


.003 


252.50 


1.000 


.003 


- 


- 


254.00 


1.000 


.002 


- 


- 


254.50 


- 


- 


1.000 


.002 


262.00 


1.000 


.001 


1.000 


.001 


270.00 


1.000 


.000 


1.000 


.000 
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Grade 4 

Winter MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


122 




Negative 


1027 




Missing 


721 


Group 2 


Positive 3 


122 




Negative 


1017 




Missing 


731 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): WintlOMCRC has at least one 
tie between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): WintlOMCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.848 


.017 


.000 


.815 .881 


Group 2 


.849 


.015 


.000 


.820 .879 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): WintlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): WintlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 4 

Winter MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.074 


.976 


.082 


.969 


1.50 


.074 


.975 


.082 


.967 


2.50 


.074 


.974 


.090 


.966 


3.50 


.074 


.971 


.090 


.965 


4.50 


.098 


.969 


.115 


.960 


5.50 


.180 


.964 


.139 


.954 


6.50 


.230 


.950 


.205 


.943 


7.50 


.311 


.940 


.303 


.925 


8.50 


.475 


.922 


.385 


.909 


9.50 


.598 


.886 


.549 


.880 


10.50 


.705 


.844 


.697 


.846 


11.50 


.787 


.794 


.803 


.790 


12.50 


.836 


.729 


.861 


.735 


13.50 


.893 


.642 


.918 


.662 


14.50 


.934 


.529 


.959 


.559 


15.50 


.975 


.411 


.975 


.429 


16.50 


.975 


.274 


.984 


.286 


17.50 


.992 


.145 


1.000 


.148 


18.50 


1.000 


.054 


1.000 


.062 


19.50 


1.000 


.015 


1.000 


.017 


21.00 


1.000 


.000 


1.000 


.000 
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Grade 4 

Spring PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


117 




Negative 


980 




Missing 


773 


Group 2 


Positive 3 


113 




Negative 


984 




Missing 


773 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOPRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOPRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.879 


.016 


.000 


.849 .910 


Group 2 


.883 


.016 


.000 


.852 .915 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOPRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOPRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 

Crossvaliclation: Group 1 




ROC Curve 



Crossvaliclation: Group 2 




Diagonal segments are produced by ties. 
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Grade 4 

Spring PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


3.00 


.000 


1.000 


- 


- 


13.00 


.009 


1.000 


- 


- 


22.00 


- 


- 


.000 


1.000 


23.50 


- 


- 


.009 


1.000 


26.50 


.017 


1.000 


- 


- 


27.50 


- 


- 


.018 


1.000 


32.00 


.026 


1.000 


- 


- 


35.00 


- 


- 


.027 


1.000 


35.50 


.034 


1.000 


- 


- 


39.00 


.043 


1.000 


- 


- 


39.50 


- 


- 


.035 


1.000 


41.50 


- 


- 


.044 


1.000 


42.00 


.051 


1.000 


- 


- 


43.50 


- 


- 


.062 


1.000 


44.50 


.051 


.999 


- 


- 


45.00 


- 


- 


.080 


1.000 


46.00 


.060 


.999 


- 


- 


46.50 


- 


- 


.088 


1.000 


47.50 


- 


- 


.097 


1.000 


48.50 


.060 


.998 


- 


- 


49.50 


- 


- 


.097 


.999 


50.50 


.060 


.997 


- 


- 


51.50 


.068 


.997 


.106 


.999 


52.50 


.077 


.997 


.115 


.999 


53.50 


.085 


.997 


.115 


.998 


54.50 


.094 


.997 


.124 


.998 


55.50 


.111 


.997 


.133 


.998 


56.50 


.128 


.997 


.142 


.998 


57.50 


.179 


.997 


- 


- 


58.00 


- 


- 


.150 


.996 


58.50 


.188 


.997 


- 


- 


59.50 


.205 


.997 


.159 


.996 


60.50 


.214 


.997 


.159 


.995 
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Grade 4 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


61.50 


.239 


.997 


.177 


.995 


62.50 


.248 


.997 


.177 


.994 


63.50 


.256 


.997 


.177 


.992 


64.50 


.256 


.996 


.186 


.991 


66.00 


.282 


.994 


.195 


.991 


67.50 


.316 


.994 


.204 


.991 


68.50 


.325 


.993 


.221 


.991 


70.50 


.342 


.993 


.230 


.989 


72.50 


.350 


.991 


.248 


.987 


73.50 


.368 


.990 


.265 


.985 


74.50 


.368 


.989 


.283 


.985 


75.50 


.385 


.986 


.301 


.981 


76.50 


.385 


.984 


.336 


.980 


77.50 


.385 


.981 


.354 


.978 


78.50 


.393 


.974 


.354 


.975 


79.50 


.402 


.968 


.372 


.975 


80.50 


.410 


.965 


.372 


.974 


81.50 


.453 


.965 


.381 


.967 


82.50 


.470 


.963 


.389 


.967 


83.50 


.470 


.961 


.398 


.967 


84.50 


.487 


.958 


.398 


.964 


85.50 


.496 


.956 


.407 


.959 


86.50 


.513 


.952 


.425 


.957 


87.50 


.530 


.944 


.442 


.952 


88.50 


.530 


.940 


.442 


.948 


89.50 


.530 


.937 


.442 


.946 


90.50 


.538 


.935 


.460 


.943 


91.50 


.547 


.929 


.460 


.941 


92.50 


.547 


.924 


.460 


.937 


93.50 


.556 


.924 


.487 


.935 


94.50 


.581 


.919 


.513 


.932 


95.50 


.581 


.915 


.540 


.927 
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Grade 4 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


96.50 


.598 


.912 


.549 


.922 


97.50 


.607 


.907 


.549 


.918 


98.50 


.607 


.901 


.584 


.916 


99.50 


.624 


.898 


.584 


.912 


100.50 


.641 


.890 


.593 


.904 


101.50 


.658 


.882 


.602 


.899 


102.50 


.658 


.879 


.637 


.897 


103.50 


.667 


.873 


.646 


.895 


104.50 


.684 


.871 


.664 


.892 


105.50 


.692 


.868 


.664 


.884 


106.50 


.692 


.865 


.673 


.875 


107.50 


.701 


.859 


.690 


.871 


108.50 


.718 


.855 


.717 


.868 


109.50 


.718 


.846 


.752 


.859 


110.50 


.744 


.831 


.770 


.848 


111.50 


.752 


.821 


.779 


.838 


112.50 


.761 


.812 


.788 


.832 


113.50 


.778 


.805 


.796 


.822 


114.50 


.778 


.799 


.796 


.817 


115.50 


.778 


.789 


.805 


.811 


116.50 


.786 


.785 


.814 


.800 


117.50 


.795 


.768 


.823 


.798 


118.50 


.812 


.756 


.823 


.788 


119.50 


.829 


.741 


.850 


.784 


120.50 


.838 


.720 


.867 


.772 


121.50 


.855 


.711 


.885 


.764 


122.50 


.872 


.702 


.894 


.755 


123.50 


.872 


.699 


.894 


.747 


124.50 


.872 


.691 


.894 


.740 


125.50 


.889 


.682 


.894 


.731 


126.50 


.897 


.678 


.894 


.718 


127.50 


.897 


.667 


.894 


.709 
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Grade 4 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


128.50 


.897 


.659 


.894 


.703 


129.50 


.897 


.650 


.903 


.693 


130.50 


.897 


.642 


.903 


.678 


131.50 


.906 


.634 


.903 


.659 


132.50 


.906 


.616 


.912 


.644 


133.50 


.932 


.610 


.929 


.633 


134.50 


.940 


.600 


.929 


.622 


135.50 


.940 


.593 


.938 


.614 


136.50 


.940 


.586 


.947 


.600 


137.50 


.940 


.572 


.947 


.587 


138.50 


.940 


.554 


.947 


.579 


139.50 


.940 


.552 


.947 


.573 


140.50 


.949 


.545 


.947 


.565 


141.50 


.949 


.538 


.947 


.558 


142.50 


.949 


.529 


.956 


.549 


143.50 


.949 


.524 


.956 


.543 


144.50 


.949 


.518 


.965 


.533 


145.50 


.957 


.511 


.965 


.522 


146.50 


.957 


.502 


.965 


.509 


147.50 


.966 


.496 


.965 


.498 


148.50 


.974 


.485 


.965 


.486 


149.50 


.974 


.457 


.965 


.473 


150.50 


.974 


.453 


.965 


.464 


151.50 


.974 


.446 


.973 


.453 


152.50 


.974 


.441 


.973 


.444 


153.50 


.974 


.426 


.973 


.439 


154.50 


.974 


.423 


.973 


.434 


155.50 


.974 


.416 


.973 


.427 


156.50 


.974 


.402 


.973 


.422 


157.50 


.974 


.392 


.973 


.413 


158.50 


.983 


.386 


.973 


.408 


159.50 


.983 


.381 


.973 


.404 


160.50 


.983 


.374 


.973 


.395 
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Grade 4 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


161.50 


.983 


.361 


.973 


.383 


162.50 


.983 


.339 


.973 


.366 


163.50 


.983 


.334 


.973 


.360 


164.50 


.983 


.329 


.973 


.351 


165.50 


.983 


.321 


.973 


.341 


166.50 


.983 


.309 


.973 


.337 


167.50 


.983 


.304 


.973 


.327 


168.50 


.983 


.300 


.973 


.325 


169.50 


.983 


.293 


.973 


.320 


170.50 


.983 


.282 


.973 


.312 


171.50 


.983 


.267 


.973 


.300 


172.50 


.983 


.259 


.973 


.286 


173.50 


.991 


.248 


.973 


.265 


174.50 


1.000 


.243 


.973 


.260 


175.50 


1.000 


.239 


.982 


.252 


176.50 


1.000 


.235 


.982 


.245 


177.50 


1.000 


.228 


.982 


.236 


178.50 


1.000 


.222 


.982 


.234 


179.50 


1.000 


.211 


.982 


.226 


180.50 


1.000 


.204 


.982 


.220 


181.50 


1.000 


.198 


.982 


.216 


182.50 


1.000 


.195 


.982 


.214 


183.50 


1.000 


.191 


.982 


.204 


184.50 


1.000 


.173 


.991 


.189 


185.50 


1.000 


.171 


.991 


.186 


186.50 


1.000 


.165 


.991 


.179 


187.50 


1.000 


.162 


.991 


.177 


188.50 


1.000 


.156 


.991 


.167 


189.50 


1.000 


.154 


.991 


.161 


190.50 


1.000 


.144 


.991 


.159 


191.50 


1.000 


.142 


1.000 


.148 


192.50 


1.000 


.135 


1.000 


.140 


193.50 


1.000 


.126 


1.000 


.122 
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Grade 4 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


194.50 


1.000 


.120 


1.000 


.118 


195.50 


1.000 


.115 


1.000 


.115 


196.50 


1.000 


.112 


1.000 


.113 


197.50 


1.000 


.110 


1.000 


.110 


198.50 


1.000 


.109 


1.000 


.106 


199.50 


1.000 


.103 


1.000 


.093 


200.50 


1.000 


.097 


1.000 


.091 


201.50 


- 


- 


1.000 


.090 


202.00 


1.000 


.096 


- 


- 


202.50 


- 


- 


1.000 


.087 


203.50 


1.000 


.091 


1.000 


.085 


204.50 


1.000 


.087 


1.000 


.082 


205.50 


1.000 


.086 


1.000 


.079 


206.50 


1.000 


.081 


1.000 


.075 


207.50 


1.000 


.080 


1.000 


.074 


208.50 


1.000 


.073 


1.000 


.071 


209.50 


1.000 


.069 


1.000 


.067 


210.50 


1.000 


.060 


1.000 


.059 


211.50 


1.000 


.057 


1.000 


.055 


212.50 


1.000 


.053 


1.000 


.051 


213.50 


1.000 


.043 


1.000 


.043 


214.50 


1.000 


.040 


1.000 


.039 


215.50 


1.000 


.036 


- 


- 


217.00 


1.000 


.035 


1.000 


.037 


218.50 


1.000 


.034 


- 


- 


219.50 


1.000 


.031 


1.000 


.036 


220.50 


1.000 


.028 


1.000 


.034 


221.50 


1.000 


.027 


1.000 


.033 


222.50 


1.000 


.024 


1.000 


.032 


223.50 


1.000 


.023 


- 


- 


224.00 


- 


- 


1.000 


.028 


224.50 


1.000 


.020 


- 


- 


226.00 


- 


- 


1.000 


.026 
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Grade 4 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


227.00 


1.000 


.018 


- 


- 


227.50 


- 


- 


1.000 


.025 


228.50 


- 


- 


1.000 


.023 


230.50 


- 


- 


1.000 


.021 


232.00 


1.000 


.016 


- 


- 


232.50 


- 


- 


1.000 


.020 


233.50 


- 


- 


1.000 


.018 


236.00 


- 


- 


1.000 


.017 


238.50 


- 


- 


1.000 


.016 


239.00 


1.000 


.015 


- 


- 


240.50 


- 


- 


1.000 


.015 


242.50 


- 


- 


1.000 


.014 


243.50 


1.000 


.014 


1.000 


.012 


246.00 


1.000 


.013 


- 


- 


248.00 


- 


- 


1.000 


.010 


248.50 


1.000 


.010 


- 


- 


249.50 


1.000 


.009 


- 


- 


250.50 


1.000 


.008 


- 


- 


252.50 


1.000 


.007 


- 


- 


253.50 


- 


- 


1.000 


.009 


254.50 


1.000 


.006 


- 


- 


255.50 


1.000 


.005 


1.000 


.007 


257.00 


1.000 


.002 


1.000 


.004 


264.00 


- 


- 


1.000 


.003 


272.50 


- 


- 


1.000 


.002 


299.00 


1.000 


.001 


- 


- 


292.50 


- 


- 


1.000 


.001 


311.00 


- 


- 


1.000 


.000 


341.00 


1.000 


.000 


- 


- 
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Grade 4 

Spring MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


122 




Negative 


1023 




Missing 


725 


Group 2 


Positive 3 


119 




Negative 


1040 




Missing 


711 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOMCRC has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOMCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


Sig. b 


Lower Bound Upper Bound 


Group 1 


.870 


.013 


.000 


.844 .896 


Group 2 


.861 


.015 


.000 


.832 .890 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 4 

Spring MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.041 


.990 


.017 


.984 


1.50 


.041 


.988 


.025 


.979 


2.50 


.041 


.986 


.042 


.978 


3.50 


.049 


.981 


.067 


.975 


4.50 


.057 


.978 


.109 


.970 


5.50 


.139 


.971 


.176 


.966 


6.50 


.230 


.953 


.261 


.947 


7.50 


.336 


.934 


.429 


.936 


8.50 


.467 


.915 


.538 


.911 


9.50 


.582 


.878 


.655 


.880 


10.50 


.713 


.846 


.706 


.840 


11.50 


.820 


.793 


.773 


.799 


12.50 


.918 


.724 


.866 


.736 


13.50 


.967 


.646 


.882 


.661 


14.50 


.967 


.553 


.941 


.576 


15.50 


.992 


.427 


.975 


.460 


16.50 


.992 


.315 


.992 


.340 


17.50 


.992 


.174 


1.000 


.189 


18.50 


1.000 


.057 


1.000 


.069 


19.50 


1.000 


.013 


1.000 


.013 


21.00 


1.000 


.000 


1.000 


.000 
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Grade 4 

Spring VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


113 




Negative 


928 




Missing 


829 


Group 2 


Positive 3 


106 




Negative 


934 




Missing 


830 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOVoc has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOVoc 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.892 


.016 


.000 


.861 .923 


Group 2 


.908 


.012 


.000 


.884 .932 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOVoc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOVoc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 4 

Spring VQC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 




.000 


1.000 


.000 


1.000 




.027 


.998 


.019 


.996 


3.50 


.035 


.997 


- 


- 




- 


- 


.019 


.995 


5.50 


.053 


.996 


.038 


.995 


6.50 


.080 


.995 


.057 


.995 


7.50 


.124 


.994 


.104 


.993 


8.50 


.204 


.994 


.160 


.989 


9.50 


.248 


.989 


.189 


.985 


10.50 


.336 


.982 


.283 


.978 


11.50 


.389 


.980 


.349 


.974 


12.50 


.451 


.976 


.425 


.970 


13.50 


.504 


.970 


.472 


.955 


14.50 


.602 


.944 


.547 


.943 


15.50 


.708 


.901 


.623 


.920 


16.50 


.752 


.870 


.736 


.885 


17.50 


.814 


.818 


.840 


.833 


18.50 


.876 


.739 


.915 


.752 


19.50 


.894 


.633 


.943 


.665 


20.50 


.929 


.532 


.981 


.569 


21.50 


.973 


.423 


.991 


.453 


22.50 


1.000 


.291 


1.000 


.315 


23.50 


1.000 


.171 


1.000 


.177 


24.50 


1.000 


.066 


1.000 


.058 


26.00 


1.000 


.000 


1.000 


.000 
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Grade 5 

Fall PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


188 




Negative 


982 




Missing 


755 


Group 2 


Positive 3 


203 




Negative 


958 




Missing 


765 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09PRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09PRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.874 


.013 


.000 


.848 .900 


Group 2 


.877 


.013 


.000 


.852 .902 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09PRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09PRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 




Diagonal segments are produced by ties. 
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Grade 5 

Fall PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


11.00 


.000 


1.000 


- 


- 


17.00 


.005 


1.000 


- 


- 


21.00 


- 


- 


.000 


1.000 


23.50 


- 


- 


.005 


1.000 


25.50 


- 


- 


.010 


1.000 


27.50 


.011 


1.000 


.015 


1.000 


32.50 


- 


- 


.020 


1.000 


33.50 


.016 


1.000 


- 


- 


34.50 


.021 


1.000 


- 


- 


35.50 


.027 


1.000 


- 


- 


38.50 


.032 


1.000 


.025 


1.000 


41.50 


- 


- 


.030 


1.000 


42.50 


.037 


1.000 


.034 


1.000 


43.50 


- 


- 


.039 


1.000 


44.50 


- 


- 


.044 


1.000 


45.00 


.043 


1.000 


- 


- 


47.00 


- 


- 


.049 


1.000 


48.00 


.043 


.999 


- 


- 


50.00 


- 


- 


.054 


1.000 


50.50 


.048 


.999 


- 


- 


51.50 


.053 


.999 


- 


- 


52.50 


- 


- 


.059 


1.000 


53.00 


.059 


.999 


- 


- 


54.50 


.069 


.999 


.064 


1.000 


55.50 


.074 


.999 


.074 


1.000 


56.50 


- 


- 


.079 


1.000 


58.00 


.085 


.999 


- 


- 


59.00 


- 


- 


.084 


1.000 


61.50 


.090 


.999 


.089 


.999 


62.50 


- 


- 


.099 


.999 


63.50 


- 


- 


.099 


.998 


64.00 


.096 


.998 


- 


- 


64.50 


- 


- 


.103 


.998 


65.50 


.101 


.998 


- 


- 


66.50 


.106 


.997 


.108 


.996 


67.50 


.117 


.997 


- 


- 


69.00 


.128 


.997 


.118 


.996 
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p. 149 



Grade 5 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


70.50 


.133 


.997 


.118 


.995 


71.50 


.144 


.996 


.128 


.994 


72.50 


- 


- 


.133 


.994 


73.00 


.154 


.996 


- 


- 


73.50 


- 


- 


.138 


.994 


74.50 


- 


- 


.153 


.993 


75.00 


.165 


.996 


- 


- 


75.50 


- 


- 


.167 


.992 


76.50 


.176 


.996 


.172 


.992 


77.50 


- 


- 


.177 


.992 


78.00 


.181 


.993 


- 


- 


78.50 


- 


- 


.192 


.991 


79.50 


.186 


.991 


.202 


.991 


80.50 


.202 


.988 


.207 


.991 


81.50 


.207 


.987 


.232 


.991 


82.50 


.213 


.986 


.251 


.991 


83.50 


.223 


.984 


.261 


.989 


84.50 


.234 


.981 


.276 


.987 


85.50 


.255 


.981 


.310 


.986 


86.50 


.271 


.981 


- 


- 


87.50 


.277 


.979 


.335 


.981 


88.50 


.282 


.976 


- 


- 


89.50 


.298 


.974 


.335 


.980 


90.50 


.303 


.973 


.360 


.979 


91.50 


- 


- 


.365 


.978 


92.00 


.314 


.973 


- 


- 


92.50 


- 


- 


.365 


.975 


93.50 


.319 


.970 


.374 


.974 


94.50 


.335 


.969 


.384 


.971 


95.50 


.346 


.969 


.399 


.970 


96.50 


.362 


.967 


.404 


.970 


97.50 


.367 


.965 


.409 


.968 


98.50 


.372 


.965 


.414 


.965 


99.50 


.394 


.964 


.429 


.963 


100.50 


.410 


.962 


.448 


.958 


101.50 


.426 


.959 


.458 


.955 


102.50 


.436 


.955 


.473 


.950 
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Grade 5 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


103.50 


.457 


.950 


.507 


.947 


104.50 


.511 


.946 


.522 


.941 


105.50 


.516 


.939 


.542 


.934 


106.50 


.532 


.932 


.557 


.931 


107.50 


.548 


.928 


.571 


.930 


108.50 


.559 


.920 


.581 


.929 


109.50 


.564 


.915 


.596 


.925 


110.50 


.569 


.912 


.606 


.922 


111.50 


.574 


.910 


.606 


.919 


112.50 


.596 


.906 


.621 


.913 


113.50 


.601 


.903 


.631 


.909 


114.50 


.606 


.899 


.635 


.903 


115.50 


.628 


.891 


.650 


.890 


116.50 


.633 


.885 


.665 


.885 


117.50 


.654 


.877 


.685 


.884 


118.50 


.670 


.864 


.700 


.873 


119.50 


.702 


.849 


.724 


.859 


120.50 


.702 


.847 


.724 


.854 


121.50 


.702 


.845 


.729 


.851 


122.50 


.713 


.843 


.734 


.840 


123.50 


.729 


.841 


.739 


.834 


124.50 


.734 


.832 


.754 


.827 


125.50 


.734 


.822 


.759 


.815 


126.50 


.755 


.813 


.764 


.808 


127.50 


.793 


.800 


.778 


.788 


128.50 


.809 


.787 


.793 


.783 


129.50 


.824 


.767 


.808 


.771 


130.50 


.835 


.764 


.813 


.767 


131.50 


.835 


.761 


.818 


.761 


132.50 


.840 


.751 


.847 


.748 


133.50 


.846 


.743 


.852 


.739 


134.50 


.872 


.735 


.852 


.731 


135.50 


.872 


.722 


.852 


.722 


136.50 


.883 


.714 


.857 


.713 


137.50 


.888 


.701 


.867 


.700 


138.50 


.894 


.687 


.877 


.687 


139.50 


.894 


.673 


.882 


.668 
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Grade 5 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


140.50 


.899 


.662 


.887 


.660 


141.50 


.910 


.656 


.887 


.650 


142.50 


.910 


.647 


.897 


.639 


143.50 


.915 


.642 


.906 


.629 


144.50 


.915 


.625 


.906 


.624 


145.50 


.920 


.608 


.906 


.612 


146.50 


.926 


.595 


.916 


.600 


147.50 


.926 


.577 


.921 


.580 


148.50 


.926 


.570 


.921 


.575 


149.50 


.941 


.555 


.931 


.561 


150.50 


.941 


.548 


.936 


.553 


151.50 


.941 


.539 


.936 


.538 


152.50 


.952 


.526 


.941 


.525 


153.50 


.952 


.515 


.951 


.511 


154.50 


.952 


.504 


.956 


.497 


155.50 


.952 


.491 


.961 


.489 


156.50 


.952 


.478 


.961 


.470 


157.50 


.968 


.457 


.961 


.454 


158.50 


.968 


.448 


.961 


.447 


159.50 


.968 


.434 


.961 


.442 


160.50 


.968 


.426 


.961 


.434 


161.50 


.973 


.416 


.966 


.425 


162.50 


.973 


.408 


.970 


.415 


163.50 


.973 


.402 


.970 


.408 


164.50 


.973 


.390 


.975 


.399 


165.50 


.979 


.371 


.975 


.387 


166.50 


.984 


.356 


.975 


.375 


167.50 


.984 


.347 


.975 


.366 


168.50 


.984 


.336 


.980 


.360 


169.50 


.989 


.329 


.980 


.352 


170.50 


.989 


.322 


.980 


.350 


171.50 


.989 


.313 


.980 


.344 


172.50 


.989 


.304 


.980 


.335 


173.50 


.989 


.296 


.980 


.326 


174.50 


.989 


.295 


.980 


.320 


175.50 


.989 


.288 


.985 


.311 


176.50 


.995 


.283 


.985 


.306 
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Grade 5 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


177.50 


.995 


.278 


.985 


.304 


178.50 


.995 


.271 


.985 


.300 


179.50 


.995 


.264 


.990 


.292 


180.50 


.995 


.254 


.995 


.281 


181.50 


.995 


.246 


.995 


.271 


182.50 


.995 


.240 


.995 


.265 


183.50 


.995 


.233 


.995 


.255 


184.50 


.995 


.226 


.995 


.251 


185.50 


.995 


.213 


.995 


.246 


186.50 


.995 


.202 


.995 


.237 


187.50 


.995 


.188 


1.000 


.221 


188.50 


.995 


.179 


1.000 


.214 


189.50 


.995 


.174 


1.000 


.210 


190.50 


.995 


.170 


1.000 


.208 


191.50 


.995 


.166 


1.000 


.205 


192.50 


.995 


.163 


1.000 


.198 


193.50 


.995 


.153 


1.000 


.194 


194.50 


.995 


.145 


1.000 


.186 


195.50 


- 


- 


1.000 


.174 


196.00 


.995 


.135 


- 


- 


196.50 


- 


- 


1.000 


.172 


197.50 


.995 


.129 


1.000 


.169 


198.50 


.995 


.126 


1.000 


.167 


199.50 


- 


- 


1.000 


.163 


200.00 


.995 


.124 


- 


- 


200.50 


- 


- 


1.000 


.161 


201.50 


.995 


.119 


1.000 


.159 


202.50 


.995 


.118 


1.000 


.153 


203.50 


- 


- 


1.000 


.148 


204.00 


.995 


.115 


- 


- 


204.50 


- 


- 


1.000 


.143 


205.50 


.995 


.113 


1.000 


.141 


206.50 


.995 


.106 


1.000 


.133 


207.50 


.995 


.097 


1.000 


.118 


208.50 


.995 


.092 


1.000 


.116 


209.50 


.995 


.088 


1.000 


.110 


210.50 


.995 


.080 


1.000 


.095 




Cross Validation: Oregon 



Appendix B 



p. 153 



Grade 5 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


211.50 


.995 


.074 


1.000 


.084 


212.50 


.995 


.060 


- 


- 


213.00 


- 


- 


1.000 


.074 


213.50 


.995 


.058 


- 


- 


214.50 


.995 


.056 


1.000 


.073 


215.50 


.995 


.055 


- 


- 


216.50 


.995 


.052 


1.000 


.069 


217.50 


.995 


.051 


- 


- 


218.50 


.995 


.049 


1.000 


.066 


219.50 


.995 


.048 


1.000 


.063 


220.50 


.995 


.046 


1.000 


.058 


221.50 


.995 


.042 


1.000 


.057 


222.50 


.995 


.039 


1.000 


.055 


223.50 


.995 


.038 


1.000 


.051 


224.50 


1.000 


.033 


1.000 


.049 


225.50 


1.000 


.030 


1.000 


.048 


226.50 


- 


- 


1.000 


.046 


227.50 


- 


- 


1.000 


.044 


228.50 


1.000 


.029 


- 


- 


229.00 


- 


- 


1.000 


.041 


230.50 


- 


- 


1.000 


.039 


231.50 


1.000 


.027 


1.000 


.037 


232.50 


1.000 


.025 


1.000 


.032 


233.50 


1.000 


.021 


- 


- 


234.00 


- 


- 


1.000 


.029 


235.00 


1.000 


.020 


- 


- 


235.50 


- 


- 


1.000 


.028 


236.50 


- 


- 


1.000 


.026 


237.50 


- 


- 


1.000 


.024 


238.00 


1.000 


.019 


- 


- 


239.00 


- 


- 


1.000 


.023 


240.50 


1.000 


.018 


1.000 


.021 


242.00 


- 


- 


1.000 


.019 


242.50 


1.000 


.015 


- 


- 


243.50 


- 


- 


1.000 


.018 


245.00 


- 


- 


1.000 


.017 


246.50 


1.000 


.014 


- 


- 
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Grade 5 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


247.50 


- 


- 


1.000 


.016 


249.50 


1.000 


.012 


1.000 


.015 


250.50 


1.000 


.011 


1.000 


.013 


251.50 


1.000 


.008 


1.000 


.009 


253.00 


1.000 


.005 


1.000 


.005 


256.00 


- 


- 


1.000 


.004 


256.50 


1.000 


.004 


- 


- 


259.00 


- 


- 


1.000 


.003 


264.00 


1.000 


.003 


- 


- 


270.50 


- 


- 


1.000 


.002 


282.00 


1.000 


.002 


- 


- 


284.00 


- 


- 


1.000 


.001 


288.00 


- 


- 


1.000 


.000 


298.00 


1.000 


.001 


- 


- 


302.00 


1.000 


.000 


- 


- 
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Grade 5 

Fall MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


198 




Negative 


1011 




Missing 


716 


Group 2 


Positive 3 


205 




Negative 


996 




Missing 


725 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09MCRC has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09MCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.863 


.015 


.000 


.834 .892 


Group 2 


.823 


.016 


.000 


.792 .854 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09MCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09MCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 5 

Fall MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


- 


- 


.029 


.984 


1.00 


.020 


.990 


- 


- 


2.00 


- 


- 


.029 


.983 


2.50 


.035 


.990 


- 


- 


3.50 


.045 


.990 


.034 


.982 


4.50 


.066 


.990 


.044 


.978 


5.50 


.106 


.987 


.083 


.975 


6.50 


.157 


.985 


.127 


.964 


7.50 


.273 


.977 


.210 


.958 


8.50 


.384 


.960 


.302 


.947 


9.50 


.515 


.950 


.429 


.926 


10.50 


.581 


.920 


.507 


.901 


11.50 


.692 


.873 


.654 


.855 


12.50 


.808 


.815 


.756 


.779 


13.50 


.864 


.716 


.829 


.684 


14.50 


.904 


.569 


.888 


.546 


15.50 


.955 


.406 


.951 


.385 


16.50 


.975 


.230 


.971 


.219 


17.50 


.985 


.099 


.995 


.097 


18.50 


.995 


.034 


.995 


.027 


19.50 


1.000 


.005 


1.000 


.002 


21.00 


1.000 


.000 


1.000 


.000 
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Grade 5 

Fall VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


169 




Negative 


904 




Missing 


852 


Group 2 


Positive 3 


183 




Negative 


884 




Missing 


859 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09Voc has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09Voc 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.921 


.010 


.000 


.903 .940 


Group 2 


.890 




.000 


.866 .914 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09Voc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09Voc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 5 

Fall VOC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.012 


.999 


.016 


.999 


2.00 


.012 


.998 


.016 


.997 


3.50 


.018 


.998 


.022 


.997 


4.50 


.030 


.998 


.027 


.997 


5.50 


.047 


.997 


.033 


.997 


6.50 


.095 


.997 


.066 


.993 


7.50 


.160 


.994 


.104 


.992 


8.50 


.231 


.993 


.148 


.992 


9.50 


.290 


.990 


.197 


.986 


10.50 


.355 


.981 


.301 


.977 


11.50 


.456 


.973 


.393 


.957 


12.50 


.533 


.955 


.497 


.945 


13.50 


.615 


.937 


.585 


.926 


14.50 


.680 


.914 


.656 


.897 


15.50 


.787 


.881 


.716 


.864 


16.50 


.858 


.840 


.820 


.821 


17.50 


.905 


.782 


.880 


.779 


18.50 


.959 


.720 


.923 


.692 


19.50 


.964 


.617 


.951 


.590 


20.50 


.988 


.513 


.956 


.494 


21.50 


1.000 


.400 


.978 


.400 


22.50 


1.000 


.265 


.995 


.274 


23.50 


1.000 


.119 


1.000 


.148 


24.50 


1.000 


.001 


1.000 


.001 


26.00 


1.000 


.000 


1.000 


.000 
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Grade 5 

Winter PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


179 




Negative 


963 




Missing 


783 


Group 2 


Positive 3 


190 




Negative 


937 




Missing 


799 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): WintlOPRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): WintlOPRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.865 


.014 


.000 


.838 .892 


Group 2 


.872 


.013 


.000 


.846 .897 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): WintlOPRF has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): WintlOPRF has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 5 

Winter PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


22.00 


.000 


1.000 


.000 


1.000 


24.50 


.006 


1.000 


- 


- 


25.50 


- 


- 


.005 


1.000 


29.00 


- 


- 


.011 


1.000 


35.00 


- 


- 


.016 


1.000 


36.50 


.011 


1.000 


- 


- 


41.00 


- 


- 


.016 


.999 


43.00 


- 


- 


.021 


.999 


44.50 


- 


- 


.026 


.999 


47.00 


- 


- 


.032 


.999 


49.50 


- 


- 


.037 


.999 


54.00 


.017 


1.000 


- 


- 


55.00 


- 


- 


.042 


.999 


61.50 


.022 


1.000 


.047 


.999 


63.00 


.028 


1.000 


- 


- 


65.00 


- 


- 


.058 


.999 


66.00 


.039 


1.000 


- 


- 


67.50 


- 


- 


.063 


.999 


68.50 


- 


- 


.074 


.999 


69.00 


.045 


1.000 


- 


- 


69.50 


- 


- 


.079 


.998 


71.00 


.050 


1.000 


- 


- 


72.00 


- 


- 


.084 


.998 


72.50 


.056 


1.000 


- 


- 


73.50 


.061 


1.000 


- 


- 


74.50 


.067 


1.000 


.089 


.998 


75.50 


- 


- 


.100 


.998 


76.50 


.067 


.999 


- 


- 


78.50 


.078 


.999 


.105 


.998 


81.50 


- 


- 


.111 


.998 


82.00 


.084 


.999 


- 


- 


82.50 


- 


- 


.116 


.998 


83.50 


- 


- 


.121 


.998 


84.50 


- 


- 


.132 


.997 


85.50 


.101 


.997 


.142 


.997 


86.50 


.134 


.996 


.168 


.996 


87.50 


.162 


.995 


.200 


.995 
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Grade 5 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


88.50 


.184 


.990 


.247 


.989 


89.50 


.184 


.989 


.258 


.988 


90.50 


.190 


.988 


.274 


.987 


91.50 


.207 


.987 


.284 


.986 


92.50 


.212 


.987 


.316 


.984 


93.50 


.218 


.987 


.321 


.982 


94.50 


.218 


.985 


.332 


.982 


95.50 


.251 


.983 


.347 


.981 


96.50 


.279 


.981 


- 


- 


97.00 


- 


- 


.363 


.978 


97.50 


.296 


.979 


- 


- 


98.50 


.307 


.975 


.368 


.977 


99.50 


.324 


.974 


.374 


.974 


100.50 


.324 


.972 


.379 


.973 


101.50 


.346 


.970 


.379 


.970 


102.50 


.346 


.966 


.379 


.969 


103.50 


.346 


.963 


.389 


.969 


104.50 


.352 


.957 


.395 


.966 


105.50 


.369 


.956 


.411 


.963 


106.50 


.374 


.954 


.437 


.959 


107.50 


.385 


.949 


.458 


.956 


108.50 


.408 


.945 


.474 


.947 


109.50 


.430 


.941 


.479 


.942 


110.50 


.458 


.929 


.489 


.935 


111.50 


.480 


.923 


.511 


.932 


112.50 


.514 


.916 


.516 


.923 


113.50 


.531 


.912 


.526 


.920 


114.50 


.542 


.907 


.537 


.917 


115.50 


.553 


.906 


.547 


.915 


116.50 


.564 


.902 


.553 


.910 


117.50 


.564 


.893 


.563 


.904 


118.50 


.581 


.889 


.584 


.900 


119.50 


.609 


.885 


- 


- 


120.00 


- 


- 


.589 


.898 


120.50 


.626 


.880 


- 


- 


121.50 


.631 


.873 


.605 


.888 


122.50 


.665 


.866 


.637 


.885 
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Grade 5 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


123.50 


.693 


.855 


.663 


.877 


124.50 


.693 


.843 


.668 


.873 


125.50 


.704 


.838 


.674 


.863 


126.50 


.715 


.837 


.695 


.856 


127.50 


.721 


.836 


.711 


.851 


128.50 


.737 


.831 


.726 


.847 


129.50 


.743 


.826 


.732 


.839 


130.50 


.754 


.818 


.732 


.827 


131.50 


.765 


.803 


.753 


.812 


132.50 


.777 


.793 


.763 


.798 


133.50 


.788 


.780 


.768 


.785 


134.50 


.810 


.766 


.784 


.778 


135.50 


.827 


.754 


.789 


.765 


136.50 


.832 


.738 


.811 


.759 


137.50 


.832 


.730 


.816 


.753 


138.50 


.838 


.727 


.832 


.746 


139.50 


.849 


.725 


.832 


.733 


140.50 


.860 


.713 


.853 


.720 


141.50 


.866 


.696 


.868 


.711 


142.50 


.872 


.692 


.874 


.701 


143.50 


.877 


.684 


.884 


.689 


144.50 


.883 


.674 


.895 


.680 


145.50 


.888 


.669 


.895 


.671 


146.50 


.888 


.660 


.895 


.657 


147.50 


.894 


.650 


.911 


.644 


148.50 


.894 


.638 


.911 


.637 


149.50 


.911 


.629 


.911 


.633 


150.50 


.911 


.622 


.911 


.619 


151.50 


.911 


.611 


.911 


.610 


152.50 


.916 


.595 


.916 


.600 


153.50 


.916 


.590 


.916 


.591 


154.50 


.916 


.574 


.921 


.582 


155.50 


.922 


.571 


.926 


.572 


156.50 


.922 


.566 


.932 


.564 


157.50 


.922 


.555 


.932 


.556 


158.50 


.944 


.548 


.932 


.554 


159.50 


.950 


.539 


.932 


.549 
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Grade 5 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


160.50 


.966 


.526 


.932 


.536 


161.50 


.966 


.516 


.937 


.521 


162.50 


.972 


.499 


.947 


.506 


163.50 


.978 


.485 


.953 


.492 


164.50 


.978 


.477 


.953 


.483 


165.50 


.978 


.468 


.963 


.473 


166.50 


.978 


.454 


.974 


.457 


167.50 


.978 


.445 


.974 


.448 


168.50 


.978 


.437 


.979 


.443 


169.50 


.978 


.428 


.979 


.434 


170.50 


.978 


.415 


.979 


.422 


171.50 


.978 


.408 


.979 


.410 


172.50 


.978 


.390 


.979 


.398 


173.50 


.978 


.383 


.979 


.392 


174.50 


.978 


.373 


.979 


.385 


175.50 


.978 


.362 


.979 


.371 


176.50 


.978 


.357 


.979 


.368 


177.50 


.978 


.340 


.979 


.360 


178.50 


.978 


.332 


.979 


.344 


179.50 


.978 


.319 


.984 


.331 


180.50 


.978 


.304 


.989 


.313 


181.50 


.983 


.291 


.989 


.312 


182.50 


.983 


.278 


.989 


.304 


183.50 


.983 


.270 


.989 


.300 


184.50 


.983 


.258 


.989 


.290 


185.50 


.983 


.252 


.989 


.287 


186.50 


.983 


.249 


.989 


.280 


187.50 


.983 


.239 


.989 


.272 


188.50 


.983 


.237 


.989 


.265 


189.50 


.983 


.233 


.989 


.259 


190.50 


.983 


.224 


.989 


.250 


191.50 


.983 


.213 


.989 


.241 


192.50 


.983 


.210 


.995 


.236 


193.50 


.989 


.202 


.995 


.228 


194.50 


.989 


.196 


.995 


.223 


195.50 


.989 


.189 


.995 


.219 


196.50 


.989 


.184 


.995 


.215 
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Grade 5 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


197.50 


.994 


.181 


.995 


.209 


198.50 


.994 


.172 


1.000 


.202 


199.50 


.994 


.163 


1.000 


.188 


200.50 


.994 


.155 


1.000 


.171 


201.50 


.994 


.153 


1.000 


.169 


202.50 


.994 


.148 


1.000 


.163 


203.50 


.994 


.143 


1.000 


.160 


204.50 


.994 


.135 


1.000 


.156 


205.50 


.994 


.134 


1.000 


.148 


206.50 


.994 


.127 


1.000 


.144 


207.50 


.994 


.124 


1.000 


.140 


208.50 


.994 


.117 


1.000 


.132 


209.50 


.994 


.112 


1.000 


.125 


210.50 


.994 


.107 


1.000 


.121 


211.50 


.994 


.103 


1.000 


.116 


212.50 


.994 


.097 


1.000 


.115 


213.50 


.994 


.089 


1.000 


.108 


214.50 


.994 


.085 


1.000 


.106 


215.50 


.994 


.076 


1.000 


.100 


216.50 


.994 


.073 


1.000 


.097 


217.50 


.994 


.072 


1.000 


.093 


218.50 


.994 


.067 


1.000 


.092 


219.50 


1.000 


.063 


1.000 


.088 


220.50 


1.000 


.061 


1.000 


.086 


221.50 


1.000 


.060 


1.000 


.081 


222.50 


1.000 


.057 


1.000 


.076 


223.50 


1.000 


.056 


1.000 


.073 


224.50 


1.000 


.054 


1.000 


.068 


225.50 


1.000 


.051 


1.000 


.067 


226.50 


1.000 


.049 


1.000 


.066 


227.50 


- 


- 


1.000 


.057 


228.00 


1.000 


.044 


- 


- 


228.50 


- 


- 


1.000 


.055 


229.50 


1.000 


.043 


1.000 


.053 


230.50 


- 


- 


1.000 


.047 


231.00 


1.000 


.042 


- 


- 


232.00 


- 


- 


1.000 


.044 




Cross Validation: Oregon 



Appendix B 



p. 168 



Grade 5 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


232.50 


1.000 


.039 


- 


- 


233.50 


1.000 


.035 


1.000 


.043 


234.50 


- 


- 


1.000 


.039 


235.50 


- 


- 


1.000 


.037 


236.00 


1.000 


.034 


- 


- 


236.50 


- 


- 


1.000 


.035 


237.50 


- 


- 


1.000 


.032 


238.50 


1.000 


.033 


1.000 


.031 


239.50 


1.000 


.032 


- 


- 


240.50 


1.000 


.030 


1.000 


.029 


241.50 


1.000 


.027 


- 


- 


242.50 


1.000 


.026 


1.000 


.028 


243.50 


1.000 


.025 


1.000 


.026 


245.00 


1.000 


.021 


1.000 


.021 


246.50 


- 


- 


1.000 


.019 


247.00 


1.000 


.020 


- 


- 


247.50 


- 


- 


1.000 


.018 


248.50 


1.000 


.017 


1.000 


.016 


250.00 


1.000 


.016 


1.000 


.015 


252.00 


1.000 


.015 


1.000 


.013 


253.50 


1.000 


.013 


1.000 


.010 


254.50 


1.000 


.011 


1.000 


.007 


255.50 


- 


- 


1.000 


.005 


260.50 


- 


- 


1.000 


.004 


261.00 


1.000 


.008 


- 


- 


268.50 


1.000 


.006 


1.000 


.003 


271.00 


1.000 


.005 


- 


- 


272.50 


1.000 


.004 


- 


- 


276.00 


- 


- 


1.000 


.002 


281.50 


1.000 


.003 


- 


- 


286.50 


- 


- 


1.000 


.001 


294.00 


- 


- 


1.000 


.000 


297.50 


1.000 


.002 


- 


- 


324.50 


1.000 


.001 


- 


- 


345.00 


1.000 


.000 


- 


- 
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Grade 5 

Winter MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


206 




Negative 


1022 




Missing 


697 


Group 2 


Positive 3 


205 




Negative 


995 




Missing 


726 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): WintlOMCRC has at least one 
tie between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): WintlOMCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.880 


.012 


.000 


.857 .903 


Group 2 


.834 


.014 


.000 


.806 .862 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): WintlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): WintlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalitlation: Group 1 




ROC Curve 



Crossvalitlation: Group 2 




Diagonal segments are produced by ties. 
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Grade 5 

Winter MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.053 


.986 


- 


- 


1.00 


- 


- 


.029 


.982 


1.50 


.058 


.985 


- 


- 


2.50 


.063 


.985 


.029 


.981 


3.50 


.063 


.983 


.034 


.981 


4.50 


.068 


.980 


.039 


.978 


5.50 


.087 


.979 


.044 


.978 


6.50 


.112 


.977 


.098 


.977 


7.50 


.170 


.975 


.127 


.975 


8.50 


.262 


.969 


.156 


.970 


9.50 


.311 


.956 


.195 


.958 


10.50 


.398 


.945 


.278 


.944 


11.50 


.539 


.933 


.322 


.925 


12.50 


.612 


.913 


.439 


.905 


13.50 


.714 


.884 


.600 


.875 


14.50 


.801 


.823 


.722 


.819 


15.50 


.888 


.724 


.834 


.727 


16.50 


.937 


.582 


.893 


.598 


17.50 


.981 


.427 


.966 


.416 


18.50 


1.000 


.240 


.985 


.223 


19.50 


1.000 


.071 


.995 


.068 


21.00 


1.000 


.000 


1.000 


.000 
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Grade 5 

Spring PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


192 




Negative 


997 




Missing 


736 


Group 2 


Positive 3 


205 




Negative 


974 




Missing 


747 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOPRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOPRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.863 


.014 


.000 


.836 .890 


Group 2 


.868 


.013 


.000 


.842 .893 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOPRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOPRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 




Diagonal segments are produced by ties. 
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Grade 5 

Spring PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


6.00 


.000 


1.000 


- 


- 


26.00 


.005 


1.000 


- 


- 


46.00 


.010 


1.000 


- 


- 


51.00 


.016 


1.000 


- 


- 


56.00 


- 


- 


.000 


1.000 


57.00 


.021 


1.000 


- 


- 


58.00 


- 


- 


.005 


1.000 


60.00 


.026 


1.000 


- 


- 


62.50 


.036 


1.000 


.010 


1.000 


66.50 


.047 


1.000 


- 


- 


67.50 


- 


- 


.015 


1.000 


69.00 


- 


- 


.020 


1.000 


70.00 


.052 


1.000 


- 


- 


70.50 


- 


- 


.029 


1.000 


71.50 


.063 


1.000 


.029 


.999 


72.50 


- 


- 


.034 


.999 


73.00 


.078 


1.000 


- 


- 


73.50 


- 


- 


.049 


.999 


74.50 


.083 


1.000 


.054 


.999 


75.50 


.089 


1.000 


.059 


.999 


76.50 


- 


- 


.068 


.999 


78.00 


.094 


1.000 


- 


- 


78.50 


- 


- 


.073 


.999 


80.50 


- 


- 


.083 


.999 


81.00 


.099 


1.000 


- 


- 


82.50 


- 


- 


.093 


.998 


83.50 


.099 


.999 


- 


- 


84.50 


- 


- 


.093 


.997 


85.50 


- 


- 


.117 


.997 


86.50 


.109 


.999 


.127 


.997 


87.50 


- 


- 


.132 


.997 


88.50 


.125 


.998 


.137 


.997 


89.50 


- 


- 


.146 


.997 


90.50 


- 


- 


.151 


.995 


91.00 


.135 


.998 


- 


- 


91.50 


- 


- 


.166 


.995 


92.50 


- 


- 


.166 


.992 
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Grade 5 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


93.50 


.156 


.998 


.176 


.992 


94.50 


.161 


.997 


.185 


.992 


95.50 


.167 


.996 


.205 


.991 


96.50 


.182 


.995 


.215 


.989 


97.50 


.193 


.994 


.220 


.989 


98.50 


.203 


.993 


.229 


.989 


99.50 


.219 


.992 


.239 


.989 


100.50 


.224 


.992 


- 


- 


101.00 


- 


- 


.239 


.988 


101.50 


.234 


.992 


- 


- 


102.50 


.240 


.992 


- 


- 


103.00 


- 


- 


.249 


.988 


103.50 


.240 


.989 


- 


- 


104.50 


.245 


.989 


.259 


.987 


105.50 


.245 


.987 


.263 


.983 


106.50 


.250 


.986 


.278 


.980 


107.50 


.255 


.985 


- 


- 


108.00 


- 


- 


.288 


.977 


108.50 


.260 


.983 


- 


- 


109.50 


.276 


.981 


.302 


.976 


110.50 


.292 


.981 


.302 


.975 


111.50 


.302 


.980 


.322 


.971 


112.50 


.302 


.979 


.332 


.971 


113.50 


.323 


.978 


.337 


.967 


114.50 


.333 


.978 


.346 


.966 


115.50 


.333 


.975 


.356 


.965 


116.50 


.349 


.973 


.390 


.960 


117.50 


.359 


.970 


.405 


.959 


118.50 


.370 


.966 


.410 


.956 


119.50 


.380 


.964 


.410 


.954 


120.50 


.391 


.959 


.424 


.952 


121.50 


.396 


.959 


.429 


.951 


122.50 


- 


- 


.439 


.951 


123.00 


.401 


.955 


- 


- 


123.50 


- 


- 


.439 


.950 


124.50 


.401 


.951 


.444 


.946 


125.50 


.411 


.949 


.459 


.941 
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p. 176 



Grade 5 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


126.50 


.417 


.947 


.478 


.940 


127.50 


.432 


.947 


.488 


.939 


128.50 


.448 


.943 


.502 


.932 


129.50 


.479 


.939 


.517 


.930 


130.50 


.495 


.931 


.541 


.925 


131.50 


.505 


.924 


.551 


.923 


132.50 


.510 


.920 


.566 


.919 


133.50 


.526 


.915 


.580 


.913 


134.50 


.547 


.906 


.600 


.900 


135.50 


.573 


.898 


.610 


.887 


136.50 


.599 


.890 


.624 


.884 


137.50 


.635 


.883 


.629 


.881 


138.50 


.641 


.875 


.644 


.875 


139.50 


.672 


.867 


.673 


.872 


140.50 


.693 


.854 


.688 


.862 


141.50 


.693 


.845 


.698 


.857 


142.50 


.703 


.840 


.702 


.847 


143.50 


.708 


.832 


.702 


.836 


144.50 


.714 


.822 


.727 


.828 


145.50 


.714 


.816 


.727 


.822 


146.50 


.714 


.807 


.741 


.815 


147.50 


.714 


.800 


.746 


.808 


148.50 


.724 


.791 


.746 


.799 


149.50 


.734 


.785 


.746 


.796 


150.50 


.745 


.778 


.751 


.789 


151.50 


.750 


.769 


.771 


.783 


152.50 


.771 


.752 


.785 


.772 


153.50 


.786 


.749 


.785 


.769 


154.50 


.792 


.746 


.785 


.766 


155.50 


.807 


.742 


.800 


.759 


156.50 


.828 


.733 


.810 


.756 


157.50 


.844 


.724 


.810 


.745 


158.50 


.854 


.704 


.824 


.734 


159.50 


.865 


.692 


.849 


.723 


160.50 


.865 


.681 


.863 


.708 


161.50 


.865 


.672 


.868 


.700 


162.50 


.875 


.663 


.878 


.691 
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p. 177 



Grade 5 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


163.50 


.885 


.644 


.878 


.674 


164.50 


.906 


.639 


.883 


.669 


165.50 


.922 


.625 


.893 


.655 


166.50 


.927 


.613 


.893 


.647 


167.50 


.927 


.602 


.893 


.642 


168.50 


.927 


.593 


.893 


.631 


169.50 


.932 


.589 


.902 


.624 


170.50 


.938 


.567 


.917 


.600 


171.50 


.948 


.559 


.922 


.587 


172.50 


.948 


.547 


.927 


.580 


173.50 


.953 


.531 


.932 


.570 


174.50 


.958 


.519 


.941 


.555 


175.50 


.964 


.506 


.951 


.541 


176.50 


.964 


.490 


.956 


.534 


177.50 


.964 


.484 


.956 


.526 


178.50 


.964 


.478 


.956 


.516 


179.50 


.964 


.470 


.956 


.504 


180.50 


.969 


.467 


.956 


.497 


181.50 


.969 


.457 


.956 


.488 


182.50 


.974 


.446 


.961 


.470 


183.50 


.974 


.435 


.961 


.459 


184.50 


.979 


.422 


.966 


.439 


185.50 


.979 


.391 


.966 


.423 


186.50 


.979 


.379 


.971 


.408 


187.50 


.979 


.368 


.971 


.400 


188.50 


- 


- 


.971 


.383 


189.00 


.979 


.359 


- 


- 


189.50 


- 


- 


.971 


.376 


190.50 


.979 


.354 


.976 


.368 


191.50 


.979 


.343 


.976 


.359 


192.50 


.979 


.329 


.980 


.347 


193.50 


.979 


.320 


.980 


.334 


194.50 


.979 


.305 


.985 


.309 


195.50 


.984 


.290 


.995 


.286 


196.50 


.984 


.281 


.995 


.277 


197.50 


.984 


.266 


.995 


.259 


198.50 


.984 


.257 


.995 


.249 
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Grade 5 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


199.50 


.984 


.241 


.995 


.236 


200.50 


.984 


.235 


.995 


.227 


201.50 


.984 


.222 


.995 


.216 


202.50 


.984 


.199 


.995 


.190 


203.50 


.984 


.194 


.995 


.187 


204.50 


.984 


.191 


.995 


.184 


205.50 


.990 


.186 


.995 


.180 


206.50 


.990 


.183 


.995 


.176 


207.50 


.990 


.177 


.995 


.168 


208.50 


.990 


.160 


.995 


.162 


209.50 


.990 


.155 


.995 


.154 


210.50 


.990 


.149 


.995 


.150 


211.50 


.990 


.147 


.995 


.147 


212.50 


.990 


.144 


1.000 


.145 


213.50 


.990 


.140 


1.000 


.139 


214.50 


.990 


.130 


1.000 


.136 


215.50 


.990 


.124 


1.000 


.127 


216.50 


.990 


.122 


1.000 


.125 


217.50 


.990 


.113 


1.000 


.121 


218.50 


.990 


.108 


1.000 


.115 


219.50 


.990 


.105 


1.000 


.109 


220.50 


.990 


.104 


1.000 


.108 


221.50 


.990 


.099 


1.000 


.104 


222.50 


.990 


.097 


1.000 


.102 


223.50 


.990 


.093 


1.000 


.099 


224.50 


.990 


.089 


1.000 


.097 


225.50 


.990 


.088 


1.000 


.093 


226.50 


.990 


.087 


1.000 


.090 


227.50 


1.000 


.079 


1.000 


.082 


228.50 


1.000 


.077 


1.000 


.078 


229.50 


- 


- 


1.000 


.074 


230.00 


1.000 


.075 


- 


- 


230.50 


- 


- 


1.000 


.073 


231.50 


1.000 


.072 


1.000 


.070 


232.50 


1.000 


.067 


1.000 


.066 


233.50 


1.000 


.064 


1.000 


.065 


234.50 


1.000 


.063 


1.000 


.064 
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Grade 5 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


235.50 


1.000 


.061 


1.000 


.062 


236.50 


1.000 


.058 


1.000 


.056 


237.50 


1.000 


.057 


1.000 


.055 


238.50 


1.000 


.049 


1.000 


.054 


239.50 


1.000 


.047 


1.000 


.048 


240.50 


1.000 


.046 


1.000 


.046 


241.50 


1.000 


.045 


1.000 


.043 


242.50 


1.000 


.041 


1.000 


.041 


243.50 


1.000 


.039 


- 


- 


244.00 


- 


- 


1.000 


.039 


244.50 


1.000 


.038 


- 


- 


245.50 


- 


- 


1.000 


.038 


246.50 


1.000 


.036 


- 


- 


247.00 


- 


- 


1.000 


.037 


248.00 


- 


- 


1.000 


.036 


249.00 


1.000 


.035 


- 


- 


249.50 


- 


- 


1.000 


.034 


250.50 


1.000 


.033 


- 


- 


251.00 


- 


- 


1.000 


.032 


252.00 


1.000 


.031 


- 


- 


252.50 


- 


- 


1.000 


.031 


253.50 


1.000 


.026 


1.000 


.027 


254.50 


1.000 


.025 


1.000 


.023 


255.50 


1.000 


.021 


1.000 


.016 


256.50 


- 


- 


1.000 


.009 


257.00 


1.000 


.011 


- 


- 


259.50 


- 


- 


1.000 


.008 


261.50 


1.000 


.010 


- 


- 


265.00 


- 


- 


1.000 


.007 


265.50 


1.000 


.009 


- 


- 


268.50 


- 


- 


1.000 


.005 


272.00 


1.000 


.008 


- 


- 


274.50 


- 


- 


1.000 


.004 


279.00 


1.000 


.007 


- 


- 


281.50 


1.000 


.005 


1.000 


.003 


285.50 


- 


- 


1.000 


.002 


286.50 


1.000 


.004 


- 


- 
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Grade 5 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


288.50 


- 


- 


1.000 


.001 


290.00 


- 


- 


1.000 


.000 


297.00 


1.000 


.002 


- 


- 


317.00 


1.000 


.001 


- 


- 


331.00 


1.000 


.000 


- 


- 
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Grade 5 

Spring MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


202 




Negative 


1012 




Missing 


711 


Group 2 


Positive 3 


205 




Negative 


976 




Missing 


745 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOMCRC has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOMCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.862 


.014 


.000 


.835 .889 


Group 2 


.849 


.014 


.000 


.820 .877 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 








Cross Validation: Oregon 



Appendix B 



p. 182 



ROC Curve 



Crossvalidation: Group 1 




ROC Curve 
Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 5 

Spring MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


- 


- 


.000 


.996 


1.50 


.040 


.992 


.005 


.996 


2.50 


- 


- 


.010 


.996 


3.50 


.050 


.992 


.015 


.996 


4.50 


.059 


.992 


.044 


.995 


5.50 


.109 


.991 


.063 


.993 


6.50 


.158 


.987 


.112 


.988 


7.50 


.233 


.978 


.141 


.983 


8.50 


.307 


.972 


.229 


.975 


9.50 


.416 


.957 


.302 


.964 


10.50 


.490 


.946 


.390 


.943 


11.50 


.594 


.922 


.527 


.926 


12.50 


.693 


.877 


.615 


.891 


13.50 


.757 


.812 


.746 


.822 


14.50 


.847 


.688 


.839 


.713 


15.50 


.931 


.506 


.912 


.506 


16.50 


.995 


.281 


.990 


.282 


17.50 


1.000 


.094 


.995 


.091 


18.50 


1.000 


.019 


1.000 


.013 


19.50 


- 


- 


1.000 


.001 


20.00 


1.000 


.000 


- 


- 


21.00 


- 


- 


1.000 


.000 
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Grade 5 

Spring VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


172 




Negative 


928 




Missing 


825 


Group 2 


Positive 3 


186 




Negative 


909 




Missing 


831 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOVoc has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOVoc 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.893 


.013 


.000 


.867 .918 


Group 2 


.878 


.013 


.000 


.853 .903 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOVoc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOVoc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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p. 185 



ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 5 

Spring VQC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


2.00 


- 


- 


.005 


.999 


2.50 


.000 


.999 


- 


- 


4.50 


- 


- 


.005 


.997 


5.50 


.012 


.999 


.005 


.996 


6.50 


.017 


.998 


.011 


.996 


7.50 


.035 


.998 


.027 


.996 


8.50 


.076 


.998 


.038 


.996 


9.50 


.110 


.997 


.065 


.992 


10.50 


.140 


.997 


.075 


.992 


11.50 


.186 


.996 


.113 


.991 


12.50 


.233 


.994 


.167 


.988 


13.50 


.314 


.988 


.204 


.982 


14.50 


.413 


.985 


.280 


.971 


15.50 


.471 


.972 


.382 


.960 


16.50 


.570 


.944 


.500 


.942 


17.50 


.669 


.906 


.624 


.911 


18.50 


.773 


.853 


.726 


.847 


19.50 


.826 


.780 


.823 


.773 


20.50 


.907 


.684 


.898 


.674 


21.50 


.942 


.564 


.957 


.573 


22.50 


.977 


.418 


.984 


.432 


23.50 


.988 


.274 


.989 


.271 


24.50 


1.000 


.129 


.995 


.106 


26.00 


1.000 


.000 


1.000 


.000 
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Grade 6 

Fall PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


132 




Negative 


436 




Missing 


1357 


Group 2 


Positive 3 


142 




Negative 


427 




Missing 


1357 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09PRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09PRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.854 


.018 




.819 .890 


Group 2 


.829 


.020 




.790 .867 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09PRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09PRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 




Diagonal segments are produced by ties. 
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Grade 6 

Fall PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


15.00 


- 


- 


.000 


1.000 


26.00 


- 


- 


.007 


1.000 


36.00 


.000 


1.000 


- 


- 


38.00 


.008 


1.000 


- 


- 


42.00 


.008 


.998 


.014 


1.000 


46.00 


.015 


.998 


- 


- 


49.50 


- 


- 


.021 


1.000 


51.00 


.023 


.998 


- 


- 


52.00 


- 


- 


.028 


1.000 


53.50 


- 


- 


.035 


1.000 


55.00 


- 


- 


.042 


1.000 


56.00 


.030 


.998 


- 


- 


56.50 


- 


- 


.056 


1.000 


58.00 


.038 


.998 


.063 


1.000 


60.00 


.045 


.998 


.070 


1.000 


61.50 


- 


- 


.085 


1.000 


62.00 


.068 


.998 


- 


- 


62.50 


- 


- 


.092 


1.000 


63.50 


- 


- 


.099 


1.000 


64.00 


.083 


.998 


- 


- 


65.00 


- 


- 


.134 


1.000 


67.00 


.091 


.998 


- 


- 


67.50 


- 


- 


.141 


1.000 


69.50 


.098 


.995 


- 


- 


70.50 


.106 


.995 


.155 


.995 


72.00 


.114 


.995 


- 


- 


72.50 


- 


- 


.162 


.995 


73.50 


.121 


.995 


- 


- 


74.00 


- 


- 


.176 


.995 


74.50 


.136 


.995 


- 


- 


75.50 


.136 


.993 


.183 


.995 


76.50 


- 


- 


.204 


.993 


78.00 


.152 


.993 


- 


- 


78.50 


- 


- 


.211 


.993 


80.50 


.174 


.989 


.218 


.991 


81.50 


.182 


.989 


.225 


.991 


82.50 


.189 


.986 


.239 


.991 
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Grade 6 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


83.50 


.212 


.986 


.246 


.991 


84.50 


.220 


.986 


- 


- 


85.00 


- 


- 


.254 


.991 


85.50 


.242 


.986 


.254 


.988 


86.50 


.242 


.984 


.261 


.988 


87.50 


.258 


.984 


.261 


.986 


88.50 


.265 


.982 


.268 


.986 


89.50 


.265 


.979 


.268 


.981 


90.50 


.265 


.972 


.275 


.981 


91.50 


.295 


.970 


.282 


.981 


92.50 


.311 


.970 


.310 


.981 


93.50 


.326 


.963 


.317 


.972 


94.50 


.356 


.959 


.317 


.970 


95.50 


.371 


.959 


.331 


.965 


96.50 


.402 


.954 


.352 


.965 


97.50 


.417 


.952 


.387 


.960 


98.50 


.439 


.943 


.430 


.953 


99.50 


.439 


.938 


.437 


.948 


100.50 


.470 


.927 


.479 


.944 


101.50 


.485 


.922 


.486 


.939 


103.00 


.485 


.917 


- 


- 


103.50 


- 


- 


.486 


.937 


104.50 


.485 


.913 


.493 


.930 


105.50 


.508 


.913 


.521 


.927 


106.50 


.523 


.911 


.528 


.920 


107.50 


.545 


.906 


.528 


.918 


108.50 


.553 


.906 


.535 


.911 


109.50 


.568 


.901 


.556 


.906 


110.50 


.576 


.897 


.563 


.902 


111.50 


.576 


.885 


.577 


.895 


112.50 


.576 


.883 


.577 


.888 


113.50 


.576 


.876 


.592 


.885 


114.50 


.591 


.872 


.599 


.881 


115.50 


.606 


.869 


.613 


.871 


116.50 


.621 


.867 


.620 


.864 


117.50 


.644 


.862 


.641 


.850 


118.50 


.689 


.851 


.648 


.834 
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Grade 6 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


119.50 


.705 


.839 


.648 


.815 


120.50 


.735 


.826 


.648 


.803 


121.50 


.773 


.826 


.655 


.794 


122.50 


.780 


.817 


.683 


.787 


123.50 


.788 


.810 


.683 


.778 


124.50 


.788 


.800 


.683 


.768 


125.50 


.795 


.789 


.697 


.763 


126.50 


.795 


.780 


.711 


.763 


127.50 


.795 


.775 


.718 


.752 


128.50 


.803 


.771 


.725 


.738 


129.50 


.803 


.768 


.739 


.731 


130.50 


.803 


.764 


.739 


.726 


131.50 


.826 


.748 


.739 


.717 


132.50 


.826 


.732 


.739 


.710 


133.50 


.841 


.722 


.746 


.705 


134.50 


.848 


.706 


.768 


.696 


135.50 


.864 


.670 


.782 


.684 


136.50 


.871 


.635 


.810 


.653 


137.50 


.879 


.603 


.838 


.618 


138.50 


.886 


.589 


.838 


.602 


139.50 


.886 


.578 


.845 


.602 


140.50 


.894 


.564 


.845 


.595 


141.50 


.894 


.555 


.866 


.581 


142.50 


.909 


.539 


.873 


.562 


143.50 


.932 


.525 


.873 


.541 


144.50 


.947 


.511 


.873 


.536 


145.50 


.947 


.500 


.887 


.522 


146.50 


.947 


.495 


.894 


.518 


147.50 


.947 


.489 


.901 


.511 


148.50 


.947 


.482 


.901 


.506 


149.50 


.947 


.475 


.908 


.499 


150.50 


.947 


.468 


.908 


.478 


151.50 


.955 


.456 


.915 


.464 


152.50 


.955 


.443 


.923 


.452 


153.50 


.955 


.427 


.923 


.443 


154.50 


.962 


.415 


.937 


.436 


155.50 


.962 


.390 


.937 


.433 
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Grade 6 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


156.50 


.962 


.374 


.937 


.426 


157.50 


.962 


.365 


.937 


.417 


158.50 


.962 


.358 


.951 


.405 


159.50 


.962 


.349 


.958 


.400 


160.50 


.962 


.342 


.958 


.393 


161.50 


.962 


.330 


.958 


.386 


162.50 


.962 


.317 


.958 


.377 


163.50 


.970 


.310 


.958 


.368 


164.50 


.970 


.298 


.958 


.354 


165.50 


.977 


.282 


.958 


.344 


166.50 


.985 


.268 


.958 


.319 


167.50 


.985 


.261 


.965 


.307 


168.50 


.985 


.255 


.965 


.300 


169.50 


.985 


.250 


.965 


.295 


170.50 


.985 


.248 


.965 


.286 


171.50 


.985 


.236 


.965 


.281 


172.50 


.985 


.234 


.965 


.279 


173.50 


.985 


.232 


.972 


.269 


174.50 


.992 


.225 


.979 


.265 


175.00 


- 


- 


.979 


.260 


176.00 


.992 


.213 


- 


- 


176.50 


- 


- 


.979 


.258 


177.50 


.992 


.206 


.986 


.248 


178.50 


.992 


.204 


.986 


.227 


179.50 


.992 


.193 


.986 


.208 


180.00 


- 


- 


.986 


.204 


181.00 


1.000 


.193 


- 


- 


181.50 


- 


- 


.993 


.201 


182.50 


1.000 


.188 


.993 


.197 


183.50 


1.000 


.186 


.993 


.192 


184.50 


1.000 


.174 


.993 


.185 


185.50 


1.000 


.158 


.993 


.173 


186.50 


1.000 


.151 


.993 


.164 


187.50 


1.000 


.149 


.993 


.162 


188.50 


1.000 


.144 


.993 


.152 


189.50 


1.000 


.135 


.993 


.141 


190.50 


- 


- 


.993 


.138 
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Grade 6 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


191.00 


1.000 


.131 


- 


- 


191.50 


- 


- 


.993 


.133 


192.50 


- 


- 


.993 


.126 


193.00 


1.000 


.128 


- 


- 


193.50 


- 


- 


.993 


.124 


195.00 


1.000 


.126 


.993 


.119 


196.50 


1.000 


.124 


.993 


.112 


197.50 


1.000 


.110 


.993 


.108 


198.50 


1.000 


.106 


- 


- 


199.50 


1.000 


.103 


- 


- 


200.00 


- 


- 


1.000 


.108 


201.00 


1.000 


.101 


- 


- 


202.50 


1.000 


.094 


1.000 


.105 


203.50 


- 


- 


1.000 


.098 


204.00 


1.000 


.092 


- 


- 


204.50 


- 


- 


1.000 


.096 


205.50 


1.000 


.089 


- 


- 


206.00 


- 


- 


1.000 


.091 


206.50 


1.000 


.085 


- 


- 


207.50 


1.000 


.083 


- 


- 


208.50 


- 


- 


1.000 


.084 


209.00 


1.000 


.078 


- 


- 


210.50 


- 


- 


1.000 


.082 


211.00 


1.000 


.076 


- 


- 


212.00 






1.000 


.080 


212.50 


1.000 


.073 


- 


- 


213.50 


1.000 


.069 


1.000 


.073 


214.50 


1.000 


.060 


- 


- 


215.00 


- 


- 


1.000 


.066 


215.50 


1.000 


.057 


- 


- 


216.50 


1.000 


.055 


1.000 


.059 


217.50 


1.000 


.044 


1.000 


.056 


218.50 


- 


- 


1.000 


.049 


219.00 


1.000 


.041 


- 


- 


219.50 


- 


- 


1.000 


.047 


220.50 


- 


- 


1.000 


.042 


221.00 


1.000 


.039 


- 


- 
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Grade 6 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


221.50 


- 


- 


1.000 


.037 


223.00 


- 


- 


1.000 


.033 


224.50 


1.000 


.037 


- 


- 


225.00 


- 


- 


1.000 


.028 


227.50 


1.000 


.034 


1.000 


.021 


228.50 


1.000 


.030 


- 


- 


230.00 


1.000 


.025 


1.000 


.019 


234.50 


1.000 


.023 


- 


- 


238.00 


- 


- 


1.000 


.016 


239.00 


1.000 


.021 


- 


- 


240.50 


1.000 


.018 


- 


- 


243.00 


1.000 


.016 


- 


- 


246.50 


1.000 


.014 


- 


- 


247.50 


- 


- 


1.000 


.012 


249.00 


1.000 


.011 


- 


- 


250.50 


- 


- 


1.000 


.009 


251.00 


1.000 


.009 


- 


- 


252.50 


- 


- 


1.000 


.007 


254.50 


- 


- 


1.000 


.005 


256.50 


1.000 


.007 


- 


- 


268.00 


1.000 


.005 


- 


- 


276.50 


- 


- 


1.000 


.002 


290.00 


1.000 


.002 


- 


- 


299.00 


- 


- 


1.000 


.000 


306.00 


1.000 


.000 


- 


- 




Cross Validation: Oregon 



Appendix B 



p. 195 



Grade 6 

Fall MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


216 




Negative 


939 




Missing 


770 


Group 2 


Positive 3 


227 




Negative 


927 




Missing 


772 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09MCRC has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09MCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.851 


.015 


.000 


.822 .880 


Group 2 


.845 


.015 


.000 


.814 .875 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09MCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09MCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 6 

Fall MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.037 


.988 


.026 


.995 


1.50 


- 


- 


.031 


.992 


2.00 


.042 


.988 


- 


- 


2.50 


- 


- 


.035 


.992 


3.50 


.046 


.987 


.040 


.992 


4.50 


.083 


.987 


.057 


.991 


5.50 


.097 


.986 


.093 


.990 


6.50 


.153 


.983 


.137 


.985 


7.50 


.194 


.979 


.216 


.980 


8.50 


.269 


.972 


.286 


.978 


9.50 


.361 


.961 


.383 


.971 


10.50 


.486 


.939 


.489 


.948 


11.50 


.583 


.916 


.564 


.921 


12.50 


.704 


.864 


.648 


.879 


13.50 


.782 


.783 


.740 


.804 


14.50 


.870 


.669 


.855 


.685 


15.50 


.917 


.497 


.903 


.525 


16.50 


.968 


.310 


.952 


.329 


17.50 


.986 


.142 


.978 


.140 


18.50 


1.000 


.031 


.996 


.040 


19.50 


1.000 


.007 


1.000 


.005 


21.00 


1.000 


.000 


1.000 


.000 
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Grade 6 

Fall VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


190 




Negative 


838 




Missing 


897 


Group 2 


Positive 3 


188 




Negative 


820 




Missing 


918 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09Voc has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09Voc 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 






.000 


.811 .869 


Group 2 


.851 




.000 


.824 .879 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09Voc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09Voc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 6 

Fall VOC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


1.00 






.000 


.999 


1.50 


.005 


.998 






2.50 






.005 


.999 


3.50 


.005 


.996 


.011 


.999 


4.50 


.011 


.996 


.016 


.998 


5.50 


.026 


.994 


.059 


.995 


6.50 


.068 


.992 


.101 


.990 


7.50 


.111 


.983 


.133 


.983 


8.50 


.211 


.961 


.245 


.965 


9.50 


.337 


.938 


.399 


.943 


10.50 


.484 


.909 


.500 


.917 


11.50 


.642 


.876 


.612 


.862 


12.50 


.732 


.821 


.702 


.813 


13.50 


.779 


.745 


.809 


.759 


14.50 


.837 


.672 


.878 


.679 


15.50 


.900 


.592 


.931 


.590 


16.50 


.932 


.493 


.947 


.501 


17.50 


.968 


.393 


.957 


.410 


18.50 


.984 


.317 


.984 


.330 


19.50 


.989 


.233 


.995 


.230 


20.50 


1.000 


.161 


.995 


.150 


21.50 


1.000 


.101 


1.000 


.098 


22.50 


1.000 


.050 


1.000 


.052 


23.50 


1.000 


.019 


1.000 


.024 


24.50 


1.000 


.005 


1.000 


.004 


26.00 


1.000 


.000 


1.000 


.000 
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Grade 6 

Winter PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


121 




Negative 


418 




Missing 


1386 


Group 2 


Positive 3 


119 




Negative 


400 




Missing 


1407 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): WintlOPRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): WintlOPRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.855 


.018 


.000 


.818 .891 


Group 2 


.830 


.021 


.000 


.788 .872 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): WintlOPRF has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): WintlOPRF has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 
Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 6 

Winter PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


28.00 


- 


- 


.000 


1.000 


36.00 


- 


- 


.008 


1.000 


47.00 


- 


- 


.017 


1.000 


52.00 


.000 


1.000 


- 


- 


55.50 


- 


- 


.025 


1.000 


56.50 


.008 


1.000 


- 


- 


60.50 


- 


- 


.034 


1.000 


61.00 


.017 


1.000 


- 


- 


61.50 


- 


- 


.050 


1.000 


63.00 


.033 


1.000 


- 


- 


64.00 


- 


- 


.059 


1.000 


64.50 


.041 


.998 


- 


- 


65.50 


.050 


.998 


- 


- 


66.50 


.058 


.998 


- 


- 


67.50 


- 


- 


.067 


1.000 


68.00 


.066 


.998 


- 


- 


69.50 


.074 


.998 


.076 


.998 


71.00 


.083 


.998 


.076 


.995 


72.50 


- 


- 


.092 


.995 


73.50 


- 


- 


.109 


.995 


74.50 


.107 


.998 


- 


- 


75.00 


- 


- 


.118 


.995 


77.50 


.124 


.998 


- 


- 


78.00 


- 


- 


.143 


.995 


78.50 


.132 


.998 


- 


- 


80.00 


.149 


.998 


- 


- 


80.50 


- 


- 


.168 


.995 


81.50 


.157 


.995 


.176 


.995 


82.50 


.174 


.995 


.176 


.993 


83.50 


- 


- 


.193 


.993 


84.00 


.174 


.993 


- 


- 


84.50 


- 


- 


.210 


.993 


85.50 


.182 


.993 


- 


- 


86.00 


- 


- 


.218 


.993 


86.50 


.190 


.993 


- 


- 


87.50 


.207 


.993 


.227 


.993 


88.50 


.207 


.990 


- 


- 
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Grade 6 

Winter PRF Benchmark 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


89.00 


- 


- 


.244 


.990 


89.50 


.215 


.990 


- 


- 


90.50 


.231 


.990 


.252 


.988 


91.50 


.240 


.990 


.252 


.985 


92.50 


.240 


.988 


- 


- 


93.00 


- 


- 


.269 


.985 


93.50 


.256 


.986 


- 


- 


94.50 


.273 


.983 


- 


- 


95.50 


.289 


.981 


- 


- 


96.50 


.306 


.981 


.277 


.983 


97.50 


.306 


.976 


- 


- 


98.50 


.322 


.974 


- 


- 


99.50 


.331 


.971 


- 


- 


100.00 


- 


- 


.277 


.980 


101.00 


.339 


.971 


- 


- 


101.50 


- 


- 


.286 


.980 


102.50 


.339 


.969 


.294 


.980 


103.50 


- 


- 


.311 


.978 


104.50 


.347 


.967 


.311 


.975 


105.50 


- 


- 


.311 


.973 


106.50 


.355 


.964 


- 


- 


107.00 


- 


- 


.319 


.973 


107.50 


.355 


.959 


- 


- 


108.50 


.364 


.952 


.345 


.973 


109.50 


.388 


.952 


.345 


.968 


110.50 


- 


- 


.370 


.958 


111.00 


.405 


.947 


- 


- 


111.50 


- 


- 


.378 


.958 


112.50 


.413 


.943 


.378 


.955 


113.50 


.438 


.943 


.395 


.955 


114.50 


.438 


.940 


.403 


.953 


115.50 


.446 


.935 


.420 


.950 


116.50 


.471 


.928 


.429 


.948 


117.50 


.496 


.926 


.437 


.948 


118.50 


.512 


.923 


.437 


.945 


119.50 


.529 


.919 


.445 


.943 


120.50 


.545 


.916 


.445 


.940 
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Grade 6 

Winter PRF Benchmark 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


121.50 


.562 


.911 


.445 


.930 


122.50 


.562 


.907 


.471 


.928 


123.50 


.570 


.904 


.479 


.928 


124.50 


.579 


.897 


.504 


.925 


125.50 


.603 


.892 


.513 


.920 


126.50 


.612 


.883 


.521 


.913 


127.50 


.620 


.883 


.521 


.910 


128.50 


.628 


.880 


.538 


.905 


129.50 


.628 


.876 


- 


- 


130.00 


- 


- 


.546 


.893 


130.50 


.628 


.868 


- 


- 


131.50 


.636 


.861 


.555 


.888 


132.50 


.661 


.856 


.580 


.878 


133.50 


.678 


.849 


.588 


.865 


134.50 


.694 


.840 


.605 


.850 


135.50 


.702 


.828 


.630 


.840 


136.50 


.719 


.816 


.655 


.835 


137.50 


.727 


.806 


.664 


.830 


138.50 


.727 


.792 


.672 


.815 


139.50 


.744 


.782 


.672 


.805 


140.50 


.752 


.770 


.672 


.800 


141.50 


.769 


.761 


.689 


.790 


142.50 


.785 


.756 


.689 


.778 


143.50 


.793 


.749 


.697 


.765 


144.50 


.802 


.732 


.706 


.750 


145.50 


.810 


.715 


.706 


.733 


146.50 


.818 


.706 


.739 


.728 


147.50 


.826 


.699 


.748 


.715 


148.50 


.843 


.694 


.773 


.710 


149.50 


.843 


.675 


.782 


.705 


150.50 


.860 


.665 


.790 


.700 


151.50 


.868 


.646 


.790 


.693 


152.50 


.884 


.634 


.798 


.683 


153.50 


.901 


.624 


.824 


.670 


154.50 


.909 


.600 


.832 


.655 


155.50 


.917 


.593 


.857 


.635 


156.50 


.917 


.577 


.874 


.623 
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p. 206 



Grade 6 

Winter PRF Benchmark 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


157.50 


.917 


.569 


.874 


.610 


158.50 


.917 


.555 


.891 


.595 


159.50 


.926 


.541 


.899 


.583 


160.50 


.926 


.526 


.899 


.568 


161.50 


.934 


.502 


.899 


.550 


162.50 


.934 


.490 


.899 


.535 


163.50 


.934 


.483 


.899 


.530 


164.50 


.942 


.471 


.908 


.518 


165.50 


.942 


.469 


.916 


.505 


166.50 


.942 


.462 


.924 


.493 


167.50 


.942 


.455 


.924 


.485 


168.50 


.959 


.440 


.933 


.475 


169.50 


.959 


.423 


.933 


.473 


170.50 


.959 


.411 


.933 


.465 


171.50 


.959 


.397 


.933 


.463 


172.50 


.959 


.383 


.941 


.443 


173.50 


.959 


.368 


.941 


.428 


174.50 


.959 


.359 


.950 


.415 


176.00 


.959 


.349 


.950 


.403 


177.50 


.959 


.342 


.950 


.395 


178.50 


.959 


.337 


.950 


.390 


179.50 


.967 


.337 


.950 


.388 


180.50 


.967 


.333 


.950 


.378 


181.50 


.975 


.325 


.950 


.370 


182.50 


.983 


.318 


.950 


.358 


183.50 


.992 


.313 


.950 


.343 


184.50 


.992 


.311 


.950 


.328 


185.50 


1.000 


.301 


.958 


.313 


186.50 


1.000 


.282 


.966 


.303 


187.50 


1.000 


.261 


.966 


.295 


188.50 


1.000 


.256 


.966 


.290 


189.50 


1.000 


.254 


.966 


.285 


190.50 


1.000 


.242 


.966 


.275 


191.50 


1.000 


.230 


.966 


.255 


192.50 


1.000 


.227 


.966 


.245 


193.50 


1.000 


.220 


.975 


.230 


194.50 


1.000 


.215 


.975 


.225 




Cross Validation: Oregon 
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p. 207 



Grade 6 

Winter PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


195.50 


1.000 


.211 


.975 


.220 


196.50 


1.000 


.206 


.975 


.213 


197.50 


1.000 


.196 


.975 


.208 


198.50 


1.000 


.189 


.975 


.203 


199.50 


1.000 


.177 


.975 


.195 


200.50 


1.000 


.172 


.975 


.193 


201.50 


1.000 


.163 


.983 


.188 


202.50 


1.000 


.158 


.983 


.180 


203.50 


1.000 


.151 


.983 


.175 


204.50 


- 


- 


.983 


.173 


205.00 


1.000 


.139 


- 


- 


206.00 


- 


- 


.983 


.163 


206.50 


1.000 


.134 


- 


- 


207.50 


1.000 


.129 


.983 


.155 


208.50 


- 


- 


.983 


.148 


209.00 


1.000 


.127 


- 


- 


209.50 


- 


- 


.983 


.145 


210.50 


1.000 


.122 


.992 


.133 


211.50 


1.000 


.117 


.992 


.128 


213.00 


1.000 


.112 


.992 


.115 


214.50 


1.000 


.105 


.992 


.113 


215.50 


1.000 


.100 


.992 


.108 


216.50 


1.000 


.098 


.992 


.100 


217.50 


1.000 


.086 


.992 


.098 


218.50 


1.000 


.079 


.992 


.093 


219.50 


- 


- 


.992 


.083 


220.00 


1.000 


.072 


- 


- 


220.50 


- 


- 


.992 


.080 


222.00 


1.000 


.069 


.992 


.078 


223.50 


1.000 


.067 


- 


- 


224.00 


- 


- 


.992 


.075 


224.50 


1.000 


.060 


- 


- 


225.50 


1.000 


.055 


.992 


.070 


226.50 


1.000 


.053 


- 


- 


227.00 


- 


- 


.992 


.068 


228.00 


1.000 


.050 


- 


- 


228.50 


- 


- 


.992 


.065 
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Grade 6 

Winter PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


229.50 


- 


- 


.992 


.060 


230.00 


1.000 


.048 


- 


- 


230.50 


- 


- 


1.000 


.060 


231.50 


1.000 


.045 


1.000 


.058 


232.50 


- 


- 


1.000 


.050 


233.00 


1.000 


.043 


- 


- 


233.50 


- 


- 


1.000 


.048 


234.50 


1.000 


.041 


- 


- 


235.00 


- 


- 


1.000 


.045 


236.50 


1.000 


.038 


1.000 


.040 


238.00 


- 


- 


1.000 


.038 


238.50 


1.000 


.036 


- 


- 


239.50 


1.000 


.033 


1.000 


.033 


241.50 


1.000 


.031 


1.000 


.028 


243.50 


1.000 


.029 


- 


- 


244.50 


- 


- 


1.000 


.025 


245.00 


1.000 


.026 


- 


- 


247.50 


1.000 


.024 


1.000 


.023 


250.00 


- 


- 


1.000 


.015 


252.00 


1.000 


.022 


- 


- 


253.00 


- 


- 


1.000 


.013 


255.50 


- 


- 


1.000 


.010 


259.50 


1.000 


.019 


- 


- 


264.00 


- 


- 


1.000 


.007 


264.50 


1.000 


.017 


- 


- 


267.00 


1.000 


.014 


- 


- 


270.50 


1.000 


.012 


- 


- 


273.00 


1.000 


.010 


- 


- 


279.50 


- 


- 


1.000 


.002 


280.50 


1.000 


.007 


- 


- 


288.00 


- 


- 


1.000 


.000 


291.50 


1.000 


.005 


- 


- 


308.00 


1.000 


.002 


- 


- 


321.00 


1.000 


.000 


- 


- 
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p. 209 



Grade 6 

Winter MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


129 




Negative 


490 




Missing 


1306 


Group 2 


Positive 3 


142 




Negative 


452 




Missing 


1332 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): WintlOMCRC has at least one 
tie between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): WintlOMCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.776 


.022 


.000 


.733 .820 


Group 2 


.815 


.020 


.000 


.776 .854 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): WintlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): WintlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 







Cross Validation: Oregon 
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p. 210 



ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 6 

Winter MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


1.00 


.023 


.957 


.092 


.960 


2.50 


- 


- 


.092 


.958 


3.00 


.023 


.955 


- 


- 


3.50 


- 


- 


.099 


.958 


4.50 


.039 


.953 


.127 


.958 


5.50 


.085 


.953 


.134 


.954 


6.50 


.132 


.953 


.211 


.947 


7.50 


.194 


.939 


.282 


.938 


8.50 


.248 


.935 


.352 


.936 


9.50 


.357 


.920 


.408 


.925 


10.50 


.419 


.876 


.514 


.887 


11.50 


.558 


.829 


.641 


.850 


12.50 


.682 


.759 


.711 


.792 


13.50 


.798 


.645 


.838 


.675 


14.50 


.915 


.492 


.901 


.515 


15.50 


.938 


.359 


.951 


.341 


16.50 


.953 


.208 


.986 


.186 


17.50 


.984 


.084 


1.000 


.058 


18.50 


.992 


.016 


1.000 


.015 


19.50 


1.000 


.002 


1.000 


.002 


21.00 


1.000 


.000 


1.000 


.000 
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Grade 6 

Spring PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


145 




Negative 


438 




Missing 


1342 


Group 2 


Positive 3 


143 




Negative 


430 




Missing 


1353 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOPRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOPRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.847 


.018 


.000 


.811 .883 


Group 2 


.841 




.000 


.804 .877 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOPRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOPRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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p. 213 



ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalitlation: Group 2 




Diagonal segments are produced by ties. 
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Grade 6 

Spring PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


28.00 


.000 


1.000 


.000 


1.000 


30.00 


- 


- 


.014 


1.000 


35.00 


- 


- 


.021 


1.000 


35.50 


.007 


1.000 


- 


- 


44.00 


- 


- 


.028 


1.000 


45.00 


.014 


1.000 


- 


- 


49.50 


.021 


1.000 


- 


- 


50.50 


- 


- 


.035 


1.000 


52.00 


.034 


1.000 


- 


- 


53.00 


- 


- 


.042 


1.000 


54.00 


.041 


1.000 


- 


- 


54.50 


- 


- 


.056 


1.000 


56.50 


.048 


1.000 


- 


- 


57.50 


- 


- 


.063 


1.000 


58.50 


.055 


1.000 


- 


- 


60.00 


.062 


1.000 


- 


- 


61.00 


- 


- 


.070 


1.000 


62.50 


.069 


1.000 


- 


- 


63.00 


- 


- 


.077 


1.000 


64.50 


.083 


1.000 


.084 


1.000 


65.50 


.090 


1.000 


.091 


.998 


66.50 


- 


- 


.112 


.998 


67.50 


.097 


1.000 


.119 


.998 


69.50 


.103 


1.000 


.133 


.998 


70.50 


.124 


.998 


- 


- 


71.50 


.124 


.995 


.140 


.998 


72.50 


- 


- 


.147 


.998 


74.00 


- 


- 


.154 


.995 


75.50 


.138 


.995 


.161 


.995 


77.00 


- 


- 


.168 


.995 


78.50 


- 


- 


.175 


.995 


79.50 


.145 


.995 


.182 


.995 


80.50 


.145 


.993 


.182 


.993 


82.00 


- 


- 


.189 


.993 


83.50 


.159 


.993 


- 


- 


84.50 


- 


- 


.196 


.993 


87.00 


.186 


.991 


.210 


.993 
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Grade 6 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


89.00 


.193 


.991 


.217 


.993 


90.50 


.200 


.991 


.224 


.993 


91.50 


.214 


.989 


.224 


.991 


92.50 


.221 


.984 


.231 


.991 


93.50 


.234 


.984 


.238 


.991 


94.50 


.241 


.984 


.245 


.988 


95.50 


.269 


.982 


.252 


.986 


96.50 


.269 


.979 


.259 


.986 


97.50 


.276 


.977 


.259 


.984 


98.50 


.290 


.975 


.259 


.981 


99.50 


.297 


.973 


.266 


.981 


100.50 


.317 


.973 


.280 


.981 


101.50 


.324 


.973 


.301 


.981 


102.50 


.338 


.968 


.308 


.981 


103.50 


.352 


.966 


.315 


.979 


104.50 


.359 


.966 


.315 


.974 


105.50 


.386 


.963 


.336 


.972 


106.50 


.407 


.959 


.350 


.970 


107.50 


.414 


.957 


.357 


.963 


108.50 


.428 


.954 


.385 


.963 


109.50 


.441 


.954 


.413 


.956 


110.50 


.441 


.952 


- 


- 


111.00 


- 


- 


.427 


.951 


111.50 


.462 


.945 


- 


- 


112.50 


.469 


.938 


.427 


.947 


113.50 


.490 


.929 


.434 


.944 


114.50 


.503 


.927 


.448 


.942 


115.50 


.503 


.925 


.476 


.937 


116.50 


.510 


.920 


.476 


.935 


117.50 


.531 


.920 


.483 


.928 


118.50 


.545 


.916 


.483 


.923 


119.50 


.552 


.909 


.483 


.916 


120.50 


.586 


.906 


.490 


.909 


121.50 


.586 


.904 


.497 


.907 


122.50 


.593 


.900 


- 


- 


12300 


- 


- 


.510 


.905 


123.50 


.600 


.893 


- 


- 
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Grade 6 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


124.50 


.600 


.890 


- 


- 


125.00 


- 


- 


.524 


.905 


125.50 


.614 


.890 


- 


- 


126.50 


.621 


.884 


.531 


.898 


127.50 


.634 


.874 


.538 


.895 


128.50 


.655 


.872 


.545 


.891 


129.50 


.655 


.868 


.559 


.886 


130.50 


.662 


.863 


.566 


.879 


131.50 


.669 


.858 


.573 


.872 


132.50 


.683 


.852 


.580 


.870 


133.50 


.690 


.849 


.594 


.860 


134.50 


.703 


.842 


.601 


.858 


135.50 


.710 


.831 


.615 


.851 


136.50 


.717 


.822 


.629 


.851 


137.50 


.724 


.808 


.636 


.849 


138.50 


.724 


.804 


.643 


.835 


139.50 


.738 


.799 


- 


- 


140.00 


- 


- 


.657 


.826 


140.50 


.738 


.792 


- 


- 


141.50 


.752 


.790 


.657 


.821 


142.50 


.759 


.785 


.671 


.819 


143.50 


.759 


.776 


.685 


.812 


144.50 


.766 


.760 


.706 


.800 


145.50 


.766 


.749 


.720 


.793 


146.50 


.766 


.744 


.741 


.788 


147.50 


.772 


.744 


.741 


.779 


148.50 


.772 


.740 


.748 


.772 


149.50 


.772 


.731 


.762 


.765 


150.50 


.786 


.721 


.762 


.747 


151.50 


.800 


.719 


.769 


.735 


152.50 


.800 


.701 


.797 


.723 


153.50 


.814 


.687 


.804 


.716 


154.50 


.814 


.680 


.804 


.714 


155.50 


.814 


.676 


.818 


.702 


156.50 


.814 


.667 


.818 


.688 


157.50 


.821 


.664 


.818 


.686 


158.50 


.828 


.653 


.825 


.674 
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Grade 6 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


159.50 


.834 


.648 


.825 


.670 


160.50 


.834 


.646 


.832 


.663 


161.50 


.848 


.630 


.839 


.649 


162.50 


.869 


.610 


.846 


.630 


163.50 


.876 


.596 


.853 


.628 


164.50 


.883 


.580 


.867 


.612 


165.50 


.883 


.573 


.867 


.605 


166.50 


.890 


.566 


.867 


.598 


167.50 


.897 


.559 


.874 


.593 


168.50 


.910 


.550 


.888 


.586 


169.50 


.910 


.543 


.895 


.577 


170.50 


.917 


.530 


.895 


.570 


171.50 


.917 


.525 


.909 


.556 


172.50 


.917 


.518 


.909 


.549 


173.50 


.917 


.509 


.916 


.542 


174.50 


.917 


.500 


.916 


.528 


175.50 


.931 


.489 


.916 


.521 


176.50 


.938 


.477 


.916 


.512 


177.50 


.945 


.473 


.916 


.509 


178.50 


.952 


.468 


.923 


.507 


179.50 


.952 


.461 


.930 


.495 


180.50 


.952 


.450 


.944 


.486 


181.50 


.952 


.438 


- 


- 


182.00 


- 


- 


.944 


.481 


182.50 


.952 


.429 


- 


- 


183.50 


.952 


.422 


.951 


.474 


184.50 


.952 


.413 


.951 


.472 


185.50 


.952 


.404 


.958 


.467 


186.50 


.952 


.395 


.958 


.465 


187.50 


.952 


.390 


.958 


.460 


188.50 


.952 


.386 


.958 


.458 


189.50 


.952 


.377 


.965 


.447 


190.50 


.952 


.374 


.965 


.433 


191.50 


.952 


.365 


.965 


.430 


192.50 


.959 


.349 


.965 


.421 


193.50 


.966 


.338 


.965 


.398 


194.50 


.966 


.311 


.965 


.367 
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Grade 6 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


195.50 


.966 


.301 


.965 


.363 


196.50 


.966 


.295 


.965 


.349 


197.50 


.966 


.283 


.965 


.344 


198.50 


.972 


.276 


.972 


.342 


199.50 


.972 


.274 


.972 


.335 


200.50 


.972 


.272 


.972 


.326 


201.50 


.972 


.265 


.972 


.319 


202.50 


.979 


.260 


.972 


.316 


203.50 


.979 


.258 


.972 


.307 


204.50 


.979 


.253 


.972 


.298 


205.50 


.986 


.249 


.972 


.295 


206.50 


.993 


.244 


.979 


.279 


207.50 


.993 


.240 


.979 


.258 


208.50 


.993 


.231 


.979 


.247 


209.50 


.993 


.221 


.979 


.240 


210.50 


.993 


.212 


.979 


.228 


211.50 


.993 


.201 


.986 


.209 


213.00 


.993 


.196 


.986 


.207 


214.50 


- 


- 


.986 


.198 


215.00 


.993 


.185 


- 


- 


215.50 


- 


- 


.986 


.195 


216.50 


.993 


.183 


.986 


.191 


217.50 


.993 


.171 


.986 


.179 


218.50 


.993 


.167 


.986 


.177 


219.50 


.993 


.164 


.986 


.174 


220.50 


.993 


.155 


.986 


.165 


221.50 


1.000 


.151 


.986 


.153 


222.50 


1.000 


.146 


.986 


.151 


223.50 


1.000 


.142 


.986 


.149 


225.00 


1.000 


.135 


.986 


.142 


226.50 


1.000 


.128 


.986 


.140 


227.50 


1.000 


.121 


.993 


.135 


228.50 


1.000 


.116 


.993 


.133 


229.50 


1.000 


.114 


.993 


.130 


230.50 


1.000 


.110 


- 


- 


231.00 


- 


- 


.993 


.123 


231.50 


1.000 


.105 


- 


- 
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Grade 6 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


232.50 


1.000 


.103 


- 


- 


233.00 


- 


- 


.993 


.119 


233.50 


1.000 


.094 


- 


- 


234.50 


1.000 


.082 


.993 


.112 


235.50 


1.000 


.073 


.993 


.109 


236.50 


1.000 


.066 


- 


- 


237.00 


- 


- 


.993 


.098 


237.50 


1.000 


.062 


- 


- 


239.00 


1.000 


.059 


.993 


.093 


240.50 


1.000 


.055 


.993 


.088 


241.50 


1.000 


.050 


- 


- 


242.50 


- 


- 


.993 


.084 


243.50 


1.000 


.046 


- 


- 


244.50 


- 


- 


.993 


.081 


245.50 


- 


- 


.993 


.079 


246.00 


1.000 


.039 






246.50 


- 


- 


.993 


.074 


248.00 


- 


- 


.993 


.070 


249.00 


1.000 


.037 


- 


- 


249.50 


- 


- 


.993 


.063 


250.50 


- 


- 


.993 


.060 


251.50 


- 


- 


.993 


.058 


252.50 


1.000 


.034 


.993 


.053 


253.50 


- 


- 


.993 


.049 


254.50 


- 


- 


.993 


.047 


255.00 


1.000 


.032 


- 


- 


255.50 


- 


- 


.993 


.042 


256.50 


1.000 


.030 


.993 


.040 


257.50 


- 


- 


.993 


.037 


258.50 


1.000 


.027 


- 


- 


260.00 


- 


- 


.993 


.033 


261.00 


1.000 


.025 


- 


- 


263.00 


1.000 


.023 


- 


- 


265.00 


1.000 


.021 


- 


- 


265.50 


- 


- 


.993 


.030 


269.00 


1.000 


.018 


- 


- 


270.00 


- 


- 


.993 


.028 
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Grade 6 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


271.50 


- 


- 


.993 


.026 


272.50 


1.000 


.016 


.993 


.023 


274.00 


- 


- 


.993 


.021 


276.50 


- 


- 


.993 


.016 


277.00 


1.000 


.014 


- 


- 


278.50 


- 


- 


.993 


.014 


280.50 


- 


- 


.993 


.009 


283.50 


- 


- 


1.000 


.009 


286.50 


1.000 


.011 


- 


- 


289.50 


- 


- 


1.000 


.007 


293.50 


1.000 


.009 


- 


- 


297.00 


- 


- 


1.000 


.005 


299.00 


1.000 


.007 


- 


- 


301.50 


- 


- 


1.000 


.002 


304.00 


- 


- 


1.000 


.000 


312.00 


1.000 


.005 


- 


- 


326.50 


1.000 


.002 


- 


- 


333.00 


1.000 


.000 


- 


- 
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Grade 6 

Spring MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


210 




Negative 


890 




Missing 


825 


Group 2 


Positive 3 


210 




Negative 


898 




Missing 


818 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOMCRC has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOMCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.823 


.017 


.000 


.790 .857 


Group 2 


.835 


.016 


.000 


.804 .866 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Gronp 2 




Diagonal segments are produced by ties. 
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Grade 6 

Spring MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


1.50 


.019 


.991 






2.00 






.019 


.989 


3.50 


.024 


.991 






4.50 


.033 


.991 


.019 


.988 


5.50 


.062 


.989 


.048 


.987 


6.50 


.105 


.988 


.071 


.986 


7.50 


.176 


.985 


.133 


.984 


8.50 


.262 


.985 


.200 


.982 


9.50 


.324 


.976 


.305 


.976 


10.50 


.395 


.958 


.405 


.961 


11.50 


.476 


.939 


.500 


.938 


12.50 


.586 


.893 


.586 


.892 


13.50 


.681 


.828 


.714 


.821 


14.50 


.786 


.720 


.800 


.735 


15.50 


.857 


.562 


.862 


.570 


16.50 


.929 


.375 


.952 


.360 


17.50 


.976 


.189 


.986 


.196 


18.50 


.990 


.052 


.995 


.068 


19.50 


1.000 


.008 


1.000 


.017 


21.00 


1.000 


.000 


1.000 


.000 
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Grade 6 

Spring VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


190 




Negative 


785 




Missing 


950 


Group 2 


Positive 3 


180 




Negative 


795 




Missing 


951 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOVoc has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOVoc 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.866 


.013 


.000 


.840 .892 


Group 2 


.873 


.014 


.000 


.846 .900 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOVoc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOVoc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 6 

Spring VQC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


- 


- 


.006 


.999 


1.00 


.000 


.999 


- 


- 


2.50 


.005 


.999 


- 


- 


3.00 


- 


- 


.006 


.997 


3.50 


.016 


.999 


- 


- 


4.50 


.026 


.999 


- 


- 


5.50 


.037 


.997 


.022 


.997 


6.50 


.042 


.996 


.050 


.997 


7.50 


.084 


.990 


.094 


.996 


8.50 


.163 


.982 


.172 


.994 


9.50 


.253 


.972 


.300 


.980 


10.50 


.358 


.959 


.389 


.971 


11.50 


.479 


.930 


.522 


.951 


12.50 


.611 


.880 


.600 


.909 


13.50 


.737 


.831 


.706 


.847 


14.50 


.816 


.783 


.800 


.772 


15.50 


.884 


.692 


.872 


.692 


16.50 


.916 


.617 


.922 


.601 


17.50 


.942 


.521 


.944 


.522 


18.50 


.979 


.413 


.972 


.429 


19.50 


.989 


.331 


.989 


.355 


20.50 


.995 


.233 


.989 


.250 


21.50 


1.000 


.154 


.994 


.147 


22.50 


1.000 


.092 


1.000 


.089 


23.50 


1.000 


.052 


1.000 


.052 


24.50 


1.000 


.014 


1.000 


.018 


26.00 


1.000 


.000 


1.000 


.000 
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Grade 7 

Fall PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


257 




Negative 


877 




Missing 


666 


Group 2 


Positive 3 


251 




Negative 


889 




Missing 


660 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09PRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09PRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.849 


.012 




.824 .873 


Group 2 


.827 


.014 




.799 .856 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09PRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09PRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 7 

Fall PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


17.00 


.000 


1.000 


- 


- 


26.00 


- 


- 


.000 


1.000 


28.00 


- 


- 


.004 


1.000 


29.00 


.004 


1.000 


- 


- 


30.50 


- 


- 


.008 


1.000 


33.00 


- 


- 


.012 


1.000 


37.50 


- 


- 


.016 


1.000 


41.50 


- 


- 


.020 


1.000 


44.00 


- 


- 


.024 


1.000 


44.50 


.008 


1.000 


- 


- 


47.50 


- 


- 


.028 


1.000 


49.50 


- 


- 


.032 


1.000 


50.00 


.012 


1.000 


- 


- 


52.50 


.016 


1.000 


.040 


1.000 


55.00 


.019 


1.000 


- 


- 


55.50 


- 


- 


.044 


.999 


57.00 


- 


- 


.048 


.999 


58.00 


.023 


1.000 


- 


- 


58.50 


- 


- 


.052 


.999 


59.50 


- 


- 


.056 


.999 


60.50 


.027 


1.000 


.060 


.999 


61.50 


.031 


1.000 


- 


- 


62.50 


.035 


1.000 


- 


- 


63.50 


.035 


.999 


.064 


.999 


65.00 


.047 


.999 


- 


- 


66.50 


- 


- 


.072 


.999 


68.50 


.058 


.999 


- 


- 


70.50 


- 


- 


.076 


.999 


71.50 


.058 


.998 


- 


- 


73.50 


.066 


.998 


- 


- 


74.50 


- 


- 


.080 


.999 


75.50 


.066 


.997 


- 


- 


76.00 


- 


- 


.088 


.998 


76.50 


.070 


.997 


- 


- 


77.50 


.074 


.997 


- 


- 


78.00 


- 


- 


.092 


.998 


79.50 


.082 


.995 


.096 


.998 
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Grade 7 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


80.50 


- 


- 


.100 


.998 


81.50 


.082 


.994 


.112 


.998 


82.50 


.093 


.994 


.120 


.998 


83.50 


.101 


.992 


.124 


.998 


84.50 


.105 


.991 


.131 


.998 


85.50 


.113 


.991 


.135 


.996 


86.50 


.121 


.991 


.143 


.996 


87.50 


.125 


.991 


.155 


.994 


88.50 


.140 


.991 


.163 


.993 


89.50 


.148 


.991 


.167 


.992 


90.50 


.152 


.990 


.179 


.991 


91.50 


.152 


.989 


.195 


.991 


92.50 


.163 


.987 


.199 


.991 


93.50 


.171 


.986 


- 


- 


94.50 


- 


- 


.207 


.991 


94.50 


.191 


.984 


- 


- 


95.50 


.191 


.982 


.215 


.989 


96.50 


.191 


.976 


.219 


.988 


97.50 


.195 


.976 


.227 


.985 


98.50 


.210 


.975 


.235 


.983 


99.50 


.257 


.975 


.247 


.982 


100.50 


- 


- 


.255 


.981 


101.00 


.261 


.974 


- 


- 


101.50 


- 


- 


.279 


.980 


102.50 


.265 


.974 


.283 


.979 


103.50 


.280 


.973 


.287 


.978 


104.50 


- 


- 


.299 


.973 


105.00 


.288 


.973 


.303 


.972 


106.50 


.304 


.970 


.315 


.971 


107.50 


.311 


.968 


.319 


.967 


108.50 


.319 


.965 


.331 


.967 


109.50 


.331 


.965 


.347 


.963 


110.50 


.335 


.965 


.355 


.960 


111.50 


.339 


.961 


.367 


.957 


112.50 


.350 


.959 


.371 


.953 


113.50 


.358 


.952 


.378 


.953 


114.50 


.370 


.948 


.386 


.949 
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Grade 7 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


115.50 


.374 


.946 


.394 


.945 


116.50 


.374 


.945 


.398 


.937 


117.50 


.385 


.943 


.426 


.929 


118.50 


.420 


.937 


.442 


.924 


119.50 


.455 


.929 


.470 


.916 


120.50 


.475 


.916 


.494 


.910 


121.50 


.486 


.906 


.510 


.901 


122.50 


.510 


.896 


.518 


.891 


123.50 


.529 


.893 


.538 


.880 


124.50 


.549 


.883 


.562 


.867 


125.50 


.603 


.872 


.586 


.853 


126.50 


.623 


.867 


.606 


.847 


127.50 


.638 


.857 


.622 


.843 


128.50 


.646 


.853 


.633 


.838 


129.50 


.661 


.846 


.645 


.835 


130.50 


.677 


.838 


.661 


.827 


131.50 


.700 


.827 


.681 


.818 


132.50 


.708 


.812 


.705 


.807 


133.50 


.716 


.799 


.717 


.796 


134.50 


.724 


.791 


.729 


.789 


135.50 


.732 


.784 


.741 


.778 


136.50 


.739 


.778 


.741 


.769 


137.50 


.751 


.774 


.745 


.757 


138.50 


.770 


.766 


.757 


.748 


139.50 


.774 


.751 


.757 


.740 


140.50 


.786 


.740 


.769 


.727 


141.50 


.798 


.732 


.773 


.717 


142.50 


.805 


.723 


.781 


.705 


143.50 


.821 


.710 


.793 


.696 


144.50 


.833 


.701 


.801 


.682 


145.50 


.837 


.690 


.809 


.672 


146.50 


.848 


.676 


.817 


.661 


147.50 


.864 


.657 


.829 


.649 


148.50 


.879 


.640 


.837 


.630 


149.50 


.879 


.631 


.837 


.624 


150.50 


.883 


.618 


.837 


.612 


151.50 


.891 


.611 


.849 


.597 
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Grade 7 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


152.50 


.895 


.602 


.853 


.586 


153.50 


.895 


.588 


.880 


.579 


154.50 


.903 


.571 


.880 


.560 


155.50 


.911 


.556 


.888 


.548 


156.50 


.918 


.545 


.888 


.533 


157.50 


.926 


.537 


.888 


.519 


158.50 


.934 


.535 


.896 


.512 


159.50 


.938 


.527 


.904 


.496 


160.50 


.942 


.513 


.904 


.490 


161.50 


.949 


.506 


.912 


.484 


162.50 


.949 


.501 


.912 


.481 


163.50 


.949 


.493 


.916 


.469 


164.50 


.953 


.482 


.916 


.458 


165.50 


.965 


.468 


.920 


.443 


166.50 


.965 


.461 


.920 


.434 


167.50 


.965 


.458 


.920 


.422 


168.50 


.965 


.452 


.932 


.414 


169.50 


.965 


.432 


.944 


.404 


170.50 


.973 


.416 


.952 


.388 


171.50 


.977 


.397 


.956 


.373 


172.50 


.977 


.391 


.956 


.364 


173.50 


.981 


.379 


.956 


.362 


174.50 


.981 


.374 


.960 


.353 


175.50 


.984 


.365 


.964 


.344 


176.50 


.984 


.357 


.968 


.332 


177.50 


.984 


.347 


.972 


.327 


178.50 


.984 


.334 


.972 


.318 


179.50 


.988 


.327 


.976 


.312 


180.50 


.988 


.309 


.976 


.297 


181.50 


.992 


.298 


.976 


.291 


182.50 


.996 


.292 


.980 


.282 


183.50 


.996 


.285 


.980 


.278 


184.50 


.996 


.279 


.980 


.272 


185.50 


1.000 


.275 


.980 


.267 


186.50 


1.000 


.267 


.980 


.260 


187.50 


1.000 


.261 


.980 


.252 


188.50 


1.000 


.257 


.984 


.245 




Cross Validation: Oregon 



Appendix B 



p. 233 



Grade 7 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


189.50 


1.000 


.243 


.984 


.235 


190.50 


1.000 


.235 


.984 


.232 


191.50 


1.000 


.226 


.984 


.226 


192.50 


1.000 


.221 


.984 


.220 


193.50 


1.000 


.212 


.984 


.209 


194.50 


1.000 


.206 


.984 


.199 


195.50 


1.000 


.192 


.988 


.189 


196.50 


1.000 


.182 


.988 


.187 


197.50 


1.000 


.178 


.988 


.182 


198.50 


1.000 


.172 


.988 


.171 


199.50 


1.000 


.162 


.992 


.164 


200.50 


1.000 


.151 


.996 


.154 


201.50 


1.000 


.144 


.996 


.153 


202.50 


1.000 


.132 


.996 


.145 


203.50 


1.000 


.129 


.996 


.141 


204.50 


1.000 


.123 


.996 


.133 


205.50 


1.000 


.120 


.996 


.110 


206.50 


1.000 


.108 


.996 


.099 


207.50 


- 


- 


.996 


.096 


208.00 


1.000 


.104 


- 


- 


208.50 


- 


- 


.996 


.094 


209.50 


1.000 


.099 


.996 


.092 


210.50 


1.000 


.092 


.996 


.088 


211.50 


1.000 


.086 


.996 


.082 


212.50 


1.000 


.082 


1.000 


.078 


213.50 


1.000 


.076 


1.000 


.075 


214.50 


1.000 


.072 


1.000 


.073 


215.50 


1.000 


.071 


1.000 


.070 


216.50 


1.000 


.070 


1.000 


.067 


217.50 


1.000 


.063 


1.000 


.064 


218.50 


1.000 


.058 


1.000 


.061 


219.50 


1.000 


.056 


1.000 


.060 


220.50 


- 


- 


1.000 


.058 


221.00 


1.000 


.048 


- 


- 


221.50 


- 


- 


1.000 


.056 


222.50 


1.000 


.043 


1.000 


.048 


223.50 


1.000 


.041 


1.000 


.046 
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p. 234 



Grade 7 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


224.50 


1.000 


.038 


1.000 


.042 


225.50 


1.000 


.034 


1.000 


.036 


226.50 


1.000 


.026 


1.000 


.030 


227.50 


- 


- 


1.000 


.027 


228.50 


1.000 


.022 


1.000 


.026 


229.50 


- 


- 


1.000 


.025 


231.00 


1.000 


.021 


1.000 


.024 


232.50 


1.000 


.019 


- 


- 


233.50 


1.000 


.018 


1.000 


.019 


234.50 


1.000 


.017 


- 


- 


235.50 


1.000 


.016 


- 


- 


236.50 


1.000 


.015 


1.000 


.017 


238.50 


1.000 


.010 


- 


- 


239.00 


- 


- 


1.000 


.016 


240.50 


1.000 


.009 


- 


- 


241.00 


- 


- 


1.000 


.013 


241.50 


1.000 


.008 


- 


- 


242.50 


1.000 


.007 


1.000 


.012 


243.50 


- 


- 


1.000 


.010 


244.00 


1.000 


.006 


- 


- 


244.50 


- 


- 


1.000 


.009 


245.50 


- 


- 


1.000 


.008 


249.00 


- 


- 


1.000 


.007 


249.50 


1.000 


.005 


- 


- 


252.50 


- 


- 


1.000 


.004 


253.50 


- 


- 


1.000 


.003 


256.00 


1.000 


.003 


1.000 


.002 


256.00 


1.000 


.003 


- 


- 


258.50 


1.000 


.002 


- 


- 


262.50 


1.000 


.001 


- 


- 


267.00 


1.000 


.000 


- 


- 


274.00 


- 


- 


1.000 


.001 


291.00 


- 


- 


1.000 


.000 
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p. 235 



Grade 7 

Fall MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


276 




Negative 


1338 




Missing 


186 


Group 2 


Positive 3 


280 




Negative 


1311 




Missing 


209 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09MCRC has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09MCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.842 


.013 


.000 


.818 .867 


Group 2 


.854 


.012 


.000 


.831 .877 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09MCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09MCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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p. 236 



ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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p. 237 



Grade 7 

Fall MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.011 


.999 


.004 


.998 


1.50 


- 


- 


.004 


.998 


2.00 


.011 


.999 


- 


- 


3.00 


- 


- 


.011 


.997 


3.50 


.022 


.997 


- 


- 


4.50 


.047 


.996 


.021 


.996 


5.50 


.080 


.993 


.036 


.993 


6.50 


.130 


.990 


.111 


.988 


7.50 


.203 


.986 


.182 


.979 


8.50 


.304 


.968 


.300 


.967 


9.50 


.402 


.942 


.400 


.951 


10.50 


.514 


.913 


.511 


.921 


11.50 


.638 


.858 


.639 


.869 


12.50 


.728 


.782 


.768 


.802 


13.50 


.837 


.694 


.854 


.702 


14.50 


.909 


.566 


.907 


.573 


15.50 


.971 


.427 


.964 


.433 


16.50 


.978 


.277 


.989 


.281 


17.50 


.978 


.145 


.989 


.143 


18.50 


.996 


.048 


1.000 


.047 


19.50 


1.000 


.008 


1.000 


.004 


21.00 


1.000 


.000 


1.000 


.000 
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p. 238 



Grade 7 

Fall VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


138 




Negative 


797 




Missing 


865 


Group 2 


Positive 3 


138 




Negative 


782 




Missing 


880 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): Fall09Voc has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):Fall09Voc 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.848 




.000 


.817 .879 


Group 2 


.849 




.000 


OO 

OO 

f-- 

00 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): Fall09Voc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): Fall09Voc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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Appendix B 



p. 239 



ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 7 

Fall VOC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


- 


- 


.014 


.994 


1.50 


- 


- 


.014 


.992 


2.00 


.000 


.997 


- 


- 


3.00 


- 


- 


.014 


.991 


4.50 


.014 


.995 


.051 


.990 


5.50 


.022 


.994 


.065 


.990 


6.50 


.094 


.986 


.109 


.986 


7.50 


.196 


.975 


.232 


.974 


8.50 


.326 


.959 


.326 


.965 


9.50 


.428 


.928 


.449 


.937 


10.50 


.565 


.886 


.565 


.890 


11.50 


.703 


.817 


.688 


.827 


12.50 


.790 


.767 


.754 


.765 


13.50 


.848 


.671 


.877 


.679 


14.50 


.920 


.588 


.899 


.600 


15.50 


.949 


.497 


.949 


.508 


16.50 


.986 


.403 


.971 


.409 


17.50 


.986 


.311 


.986 


.317 


18.50 


.993 


.248 


.993 


.261 


19.50 


.993 


.188 


.993 


.194 


20.50 


1.000 


.133 


.993 


.139 


21.50 


1.000 


.089 


.993 


.092 


22.50 


1.000 


.049 


.993 


.054 


23.50 


1.000 


.026 


.993 


.012 


24.50 


1.000 


.010 


1.000 


.008 


26.00 


1.000 


.000 


1.000 


.000 
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Grade 7 

Winter PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


249 




Negative 


889 




Missing 


662 


Group 2 


Positive 3 


248 




Negative 


900 




Missing 


652 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): WintlOPRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): WintlOPRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.859 


.013 


.000 


.834 .884 


Group 2 


.853 


.013 


.000 


.827 .879 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): WintlOPRF has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): WintlOPRF has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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p. 242 



ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Gronp 2 




Diagonal segments are produced by ties. 
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Grade 7 

Winter PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


24.00 


- 


- 


.000 


1.000 


29.50 


- 


- 


.004 


1.000 


35.00 


- 


- 


.008 


1.000 


37.00 


- 


- 


.012 


1.000 


46.00 


- 


- 


.016 


1.000 


53.00 


.000 


1.000 


- 


- 


54.50 


- 


- 


.020 


1.000 


55.00 


.004 


1.000 


- 


- 


55.50 


- 


- 


.024 


1.000 


56.50 


- 


- 


.028 


1.000 


57.50 


- 


- 


.032 


1.000 


59.50 


.008 


1.000 


- 


- 


60.00 


- 


- 


.036 


1.000 


63.00 


- 


- 


.040 


1.000 


64.00 


.028 


1.000 


- 


- 


66.50 


.032 


1.000 


.052 


1.000 


68.00 


- 


- 


.056 


1.000 


70.00 


.036 


1.000 


.060 


1.000 


71.50 


- 


- 


.065 


1.000 


73.50 


- 


- 


.069 


1.000 


74.50 


.040 


.999 


- 


- 


75.50 


- 


- 


.077 


1.000 


76.50 


- 


- 


.077 


.999 


77.50 


.052 


.999 


- 


- 


78.00 


- 


- 


.085 


.999 


78.50 


.060 


.999 


- 


- 


79.50 


.076 


.999 


- 


- 


81.00 


.080 


.999 


.089 


.999 


83.00 


.084 


.998 


- 


- 


83.50 


- 


- 


.097 


.999 


84.50 


- 


- 


.105 


.999 


85.00 


.096 


.998 


- 


- 


85.50 


- 


- 


.117 


.999 


86.50 


.100 


.998 


- 


- 


87.00 


- 


- 


.121 


.999 


88.00 


.108 


.998 


- 


- 


89.00 


- 


- 


.129 


.999 
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Grade 7 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


89.50 


.112 


.998 


- 


- 


90.50 


.120 


.998 


- 


- 


91.50 


.124 


.998 


.137 


.999 


92.50 


.129 


.998 


- 


- 


93.50 


.133 


.997 


- 


- 


94.50 


.137 


.996 


.141 


.999 


96.00 


.141 


.996 


- 


- 


96.50 


- 


- 


.149 


.999 


97.50 


.149 


.993 


.153 


.998 


98.50 


.161 


.992 


.157 


.997 


99.50 


.185 


.989 


.165 


.994 


100.50 


.201 


.987 


.177 


.993 


101.50 


.213 


.985 


.185 


.993 


102.50 


.225 


.985 


.210 


.990 


103.50 


.229 


.984 


.234 


.990 


104.50 


.249 


.984 


.238 


.989 


105.50 


.253 


.984 


.250 


.986 


106.50 


.289 


.980 


.266 


.983 


107.50 


.297 


.980 


.274 


.983 


108.50 


.309 


.978 


.278 


.982 


109.50 


.317 


.974 


.298 


.979 


110.50 


.321 


.972 


.315 


.974 


111.50 


.329 


.965 


.335 


.972 


112.50 


.333 


.962 


.351 


.969 


113.50 


.333 


.961 


.379 


.967 


114.50 


.337 


.958 


.403 


.962 


115.50 


.357 


.957 


.415 


.959 


116.50 


.361 


.953 


.419 


.956 


117.50 


.373 


.952 


- 


- 


118.00 


- 


- 


.427 


.952 


118.50 


.378 


.951 


- 


- 


119.50 


.394 


.948 


.440 


.946 


120.50 


.406 


.942 


.444 


.942 


121.50 


.414 


.939 


.444 


.941 


122.50 


.434 


.939 


.448 


.939 


123.50 


.446 


.936 


.460 


.933 


124.50 


.458 


.934 


.464 


.929 
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Grade 7 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


125.50 


.462 


.931 


.472 


.926 


126.50 


.482 


.926 


.480 


.922 


127.50 


.494 


.921 


.492 


.918 


128.50 


.514 


.917 


.492 


.916 


129.50 


.526 


.912 


.516 


.909 


130.50 


.538 


.908 


.540 


.904 


131.50 


.546 


.906 


.556 


.900 


132.50 


.558 


.901 


.569 


.891 


133.50 


.578 


.898 


.581 


.886 


134.50 


.594 


.893 


.605 


.882 


135.50 


.594 


.892 


.617 


.879 


136.50 


.602 


.891 


.633 


.876 


137.50 


.627 


.885 


.637 


.867 


138.50 


.631 


.881 


.641 


.861 


139.50 


.647 


.879 


.657 


.859 


140.50 


.663 


.875 


.661 


.856 


141.50 


.667 


.872 


.669 


.849 


142.50 


.679 


.865 


.685 


.836 


143.50 


.687 


.859 


.710 


.831 


144.50 


.703 


.856 


.722 


.828 


145.50 


.707 


.850 


.738 


.820 


146.50 


.719 


.838 


.738 


.816 


147.50 


.735 


.834 


.746 


.809 


148.50 


.763 


.823 


.758 


.804 


149.50 


.767 


.816 


.766 


.789 


150.50 


.771 


.810 


.770 


.781 


151.50 


.779 


.803 


.770 


.772 


152.50 


.787 


.793 


.782 


.767 


153.50 


.791 


.778 


.786 


.761 


154.50 


.795 


.766 


.806 


.751 


155.50 


.803 


.758 


.810 


.741 


156.50 


.815 


.746 


.823 


.733 


157.50 


.815 


.736 


.831 


.724 


158.50 


.823 


.718 


.831 


.718 


159.50 


.831 


.702 


.839 


.707 


160.50 


.839 


.691 


.847 


.696 


161.50 


.839 


.685 


.851 


.689 
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Grade 7 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


162.50 


.839 


.681 


.855 


.683 


163.50 


.855 


.677 


.863 


.673 


164.50 


.871 


.664 


.871 


.664 


165.50 


.871 


.654 


.875 


.657 


166.50 


.876 


.649 


.879 


.649 


167.50 


.880 


.641 


.887 


.638 


168.50 


.880 


.631 


.887 


.626 


169.50 


.888 


.616 


.891 


.610 


170.50 


.900 


.610 


.899 


.600 


171.50 


.904 


.593 


.903 


.590 


172.50 


.908 


.591 


.903 


.579 


173.50 


.920 


.584 


.907 


.572 


174.50 


.924 


.576 


.911 


.556 


175.50 


.928 


.565 


.911 


.550 


176.50 


.928 


.557 


.915 


.536 


177.50 


.932 


.550 


.915 


.530 


178.50 


.936 


.541 


.919 


.526 


179.50 


.936 


.532 


.919 


.512 


180.50 


.936 


.524 


.919 


.509 


181.50 


.936 


.515 


.923 


.502 


182.50 


.948 


.512 


.923 


.496 


183.50 


.948 


.506 


.927 


.491 


184.50 


.948 


.494 


.931 


.481 


185.50 


.948 


.492 


.931 


.471 


186.50 


.952 


.484 


.935 


.462 


187.50 


.956 


.470 


.935 


.451 


188.50 


.960 


.460 


.944 


.441 


189.50 


.960 


.452 


.952 


.436 


190.50 


.960 


.445 


.952 


.427 


191.50 


.960 


.436 


.952 


.417 


192.50 


.960 


.422 


.960 


.404 


193.50 


.964 


.408 


.960 


.394 


194.50 


.972 


.400 


.960 


.384 


195.50 


.972 


.398 


.960 


.378 


196.50 


.972 


.391 


.960 


.376 


197.50 


.972 


.387 


.964 


.367 


198.50 


.976 


.381 


.968 


.359 
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Grade 7 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


199.50 


.980 


.377 


.968 


.353 


200.50 


.980 


.367 


.972 


.340 


201.50 


.980 


.354 


.972 


.333 


202.50 


.980 


.342 


.976 


.323 


203.50 


.980 


.332 


.976 


.313 


204.50 


.980 


.307 


.980 


.301 


205.50 


.980 


.301 


.980 


.298 


206.50 


.980 


.295 


.980 


.294 


207.50 


.980 


.286 


.980 


.280 


208.50 


.980 


.280 


- 


- 


209.00 


- 


- 


.980 


.273 


209.50 


.984 


.274 


- 


- 


210.50 


.984 


.267 


.984 


.267 


211.50 


.984 


.255 


.984 


.264 


212.50 


.988 


.247 


.988 


.256 


213.50 


.988 


.244 


.988 


.253 


214.50 


.988 


.242 


.988 


.248 


215.50 


.988 


.238 


.988 


.241 


216.50 


.988 


.233 


.988 


.232 


217.50 


.988 


.223 


.988 


.228 


218.50 


.988 


.216 


.988 


.218 


219.50 


.988 


.205 


.988 


.199 


220.50 


.988 


.184 


.988 


.183 


221.50 


.988 


.180 


.988 


.181 


222.50 


.988 


.178 


.988 


.168 


223.50 


.988 


.175 


.988 


.159 


224.50 


.992 


.171 


.988 


.153 


225.50 


.992 


.168 


.988 


.151 


226.50 


.992 


.163 


.988 


.148 


227.50 


.992 


.156 


.988 


.143 


228.50 


.992 


.150 


.992 


.134 


229.50 


.992 


.148 


.992 


.133 


230.50 


.992 


.143 


.996 


.131 


231.50 


.992 


.128 


.996 


.123 


232.50 


.992 


.121 


.996 


.114 


233.50 


.992 


.119 


.996 


.108 


234.50 


.996 


.119 


.996 


.101 




Cross Validation: Oregon 



Appendix B 



p. 248 



Grade 7 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


235.50 


.996 


.117 


.996 


.098 


236.50 


.996 


.115 


.996 


.097 


237.50 


.996 


.108 


.996 


.094 


238.50 


.996 


.106 


.996 


.093 


239.50 


.996 


.102 


.996 


.089 


240.50 


.996 


.099 


.996 


.086 


241.50 


.996 


.096 


.996 


.083 


242.50 


.996 


.092 


.996 


.078 


243.50 


.996 


.089 


.996 


.076 


244.50 


.996 


.087 


.996 


.071 


245.50 


.996 


.081 


.996 


.066 


246.50 


.996 


.071 


.996 


.064 


247.50 


.996 


.067 


.996 


.060 


249.00 


1.000 


.063 


1.000 


.057 


250.50 


1.000 


.055 


1.000 


.052 


251.50 


1.000 


.054 


1.000 


.051 


252.50 


1.000 


.052 


1.000 


.050 


253.50 


1.000 


.046 


1.000 


.047 


254.50 


- 


- 


1.000 


.043 


255.00 


1.000 


.045 


- 


- 


255.50 


- 


- 


1.000 


.041 


257.00 


1.000 


.037 


1.000 


.034 


258.50 


- 


- 


1.000 


.032 


259.00 


1.000 


.036 


- 


- 


260.50 


- 


- 


1.000 


.031 


261.00 


1.000 


.034 


- 


- 


262.50 


1.000 


.030 


1.000 


.029 


263.50 


1.000 


.027 


1.000 


.027 


264.50 


1.000 


.025 


1.000 


.024 


265.50 


1.000 


.024 


1.000 


.022 


266.50 


- 


- 


1.000 


.021 


267.00 


1.000 


.022 


- 


- 


267.50 


- 


- 


1.000 


.020 


269.00 


- 


- 


1.000 


.017 


270.50 


1.000 


.020 


- 


- 


272.00 


- 


- 


1.000 


.016 


273.50 


1.000 


.019 


- 


- 




Cross Validation: Oregon 



Appendix B 



p. 249 



Grade 7 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


274.50 


- 


- 


1.000 


.014 


275.50 


- 


- 


1.000 


.013 


276.50 


- 


- 


1.000 


.011 


277.00 


1.000 


.017 


- 


- 


277.50 


- 


- 


1.000 


.010 


280.00 


- 


- 


1.000 


.008 


281.50 


1.000 


.015 


- 


- 


283.00 


- 


- 


1.000 


.006 


283.50 


1.000 


.013 


- 


- 


284.50 


1.000 


.010 


- 


- 


286.50 


1.000 


.009 


- 


- 


287.00 


- 


- 


1.000 


.003 


289.00 


1.000 


.008 


- 


- 


292.00 


1.000 


.006 


- 


- 


295.50 


- 


- 


1.000 


.002 


297.00 


1.000 


.004 


- 


- 


300.50 


1.000 


.003 


- 


- 


302.00 


- 


- 


1.000 


.000 


309.00 


1.000 


.002 


- 


- 


325.00 


1.000 


.001 


- 


- 


334.00 


1.000 


.000 


- 


- 




Cross Validation: Oregon 



Appendix B 



p. 250 



Grade 7 

Winter MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


208 




Negative 


819 




Missing 


773 


Group 2 


Positive 3 


212 




Negative 


811 




Missing 


777 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): WintlOMCRC has at least one 
tie between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): WintlOMCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.855 


.015 


.000 


.825 .885 


Group 2 


.844 


.016 


.000 


.813 .875 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): WintlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): WintlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 







Cross Validation: Oregon 
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p. 251 



ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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p. 252 



Grade 7 

Winter MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.019 


.995 


- 


- 


1.50 


.024 


.994 


.014 


.996 


3.00 


.029 


.994 


.024 


.996 


4.50 


.048 


.994 


.047 


.994 


5.50 


.072 


.994 


.057 


.991 


6.50 


.111 


.994 


.104 


.990 


7.50 


.163 


.991 


.146 


.986 


8.50 


.236 


.989 


.208 


.984 


9.50 


.332 


.985 


.302 


.977 


10.50 


.413 


.967 


.387 


.958 


11.50 


.519 


.941 


.505 


.940 


12.50 


.625 


.894 


.599 


.900 


13.50 


.736 


.827 


.722 


.835 


14.50 


.837 


.720 


.821 


.730 


15.50 


.909 


.565 


.901 


.561 


16.50 


.947 


.355 


.948 


.369 


17.50 


.986 


.156 


.958 


.186 


18.50 


1.000 


.043 


1.000 


.054 


19.50 


1.000 


.005 


1.000 


.002 


21.00 


1.000 


.000 


1.000 


.000 
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p. 253 



Grade 7 

Spring PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


285 




Negative 


918 




Missing 


597 


Group 2 


Positive 3 


286 




Negative 


910 




Missing 


604 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOPRF has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOPRF 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.854 


.012 


.000 


.830 .878 


Group 2 


.839 


.013 


.000 


.813 .864 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOPRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOPRF has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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p. 254 



ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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p. 255 



Grade 7 

Spring PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


- 


- 


.000 


1.000 


13.50 


- 


- 


.003 


1.000 


28.00 


- 


- 


.007 


1.000 


31.00 


- 


- 


.010 


1.000 


33.50 


- 


- 


.014 


1.000 


34.00 


.000 


1.000 


- 


- 


35.50 


- 


- 


.017 


1.000 


38.00 


- 


- 


.021 


1.000 


39.00 


.004 


1.000 


- 


- 


40.00 


- 


- 


.024 


1.000 


41.50 


- 


- 


.028 


1.000 


42.50 


- 


- 


.031 


1.000 


44.50 


.007 


1.000 


- 


- 


46.00 


- 


- 


.035 


1.000 


46.50 


.014 


1.000 


- 


- 


48.50 


.025 


1.000 


- 


- 


50.00 


- 


- 


.038 


1.000 


50.50 


.028 


1.000 


- 


- 


52.00 


.032 


1.000 


- 


- 


52.50 


- 


- 


.042 


1.000 


54.50 


- 


- 


.049 


1.000 


55.00 


.035 


1.000 


- 


- 


55.50 


- 


- 


.052 


1.000 


57.50 


- 


- 


.056 


1.000 


58.00 


.039 


1.000 


- 


- 


60.00 


.049 


1.000 


- 


- 


61.50 


.049 


.999 


- 


- 


62.00 


- 


- 


.059 


1.000 


63.50 


.053 


.999 


- 


- 


66.00 


- 


- 


.066 


1.000 


67.50 


.056 


.999 


- 


- 


68.00 


- 


- 


.073 


1.000 


70.00 


- 


- 


.073 


.999 


72.00 


.060 


.999 


.077 


.999 


73.50 


- 


- 


.077 


.998 


74.50 


.063 


.999 


.080 


.997 


75.50 


.070 


.999 


- 


- 




Cross Validation: Oregon 
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p. 256 



Grade 7 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


76.00 


- 


- 


.094 


.997 


76.50 


.084 


.999 


- 


- 


77.50 


- 


- 


.098 


.997 


78.00 


.091 


.999 


- 


- 


78.50 


- 


- 


.101 


.997 


79.50 


- 


- 


.105 


.997 


80.00 


.095 


.999 


- 


- 


80.50 


- 


- 


.108 


.997 


81.50 


.105 


.998 


.112 


.997 


82.50 


- 


- 


.119 


.997 


83.00 


.112 


.997 


- 


- 


83.50 


- 


- 


.126 


.997 


84.50 


.116 


.997 


.133 


.996 


85.50 


.119 


.997 


.136 


.996 


86.50 


.123 


.997 


.140 


.995 


87.50 


.126 


.997 


.157 


.993 


88.50 


.137 


.996 


.164 


.993 


90.00 


.140 


.996 


.171 


.992 


91.50 


.161 


.991 


.178 


.992 


92.50 


.172 


.988 


.189 


.991 


93.50 


.175 


.988 


.196 


.990 


94.50 


.179 


.987 


.203 


.988 


95.50 


.189 


.986 


.217 


.987 


96.50 


.204 


.985 


.227 


.986 


97.50 


.207 


.981 


.248 


.984 


98.50 


.218 


.978 


.255 


.982 


99.50 


.232 


.975 


.269 


.981 


100.50 


.249 


.975 


.283 


.980 


101.50 


.263 


.974 


.311 


.978 


102.50 


.288 


.974 


.315 


.976 


103.50 


.312 


.971 


.322 


.968 


104.50 


.323 


.966 


.332 


.963 


105.50 


.337 


.964 


.343 


.958 


106.50 


.344 


.961 


.360 


.954 


107.50 


.347 


.959 


.371 


.953 


108.50 


.358 


.956 


- 


- 


109.00 


- 


- 


.371 


.952 




Cross Validation: Oregon 
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p. 257 



Grade 7 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


109.50 


.372 


.953 


- 


- 


110.50 


.389 


.953 


.385 


.949 


111.50 


.404 


.949 


.399 


.948 


112.50 


.407 


.947 


.413 


.948 


113.50 


.411 


.943 


.427 


.942 


114.50 


.414 


.943 


.430 


.937 


115.50 


.432 


.941 


.430 


.934 


116.50 


.449 


.938 


.441 


.933 


117.50 


.456 


.935 


.444 


.932 


118.50 


.460 


.934 


.455 


.927 


119.50 


.470 


.932 


.472 


.921 


120.50 


.481 


.925 


.479 


.919 


121.50 


.491 


.918 


.500 


.912 


122.50 


.505 


.912 


.507 


.903 


123.50 


.512 


.907 


.507 


.902 


124.50 


.530 


.904 


.517 


.900 


125.50 


.544 


.899 


.521 


.895 


126.50 


.558 


.894 


.538 


.888 


127.50 


.568 


.893 


.556 


.882 


128.50 


.582 


.889 


.563 


.877 


129.50 


.589 


.888 


.570 


.874 


130.50 


.611 


.885 


.573 


.870 


131.50 


.614 


.879 


.587 


.867 


132.50 


.625 


.873 


.605 


.862 


133.50 


.642 


.865 


.615 


.855 


134.50 


.642 


.858 


.626 


.846 


135.50 


.646 


.854 


.643 


.836 


136.50 


.656 


.846 


.671 


.826 


137.50 


.660 


.840 


.689 


.820 


138.50 


.677 


.837 


.696 


.809 


139.50 


.684 


.832 


.703 


.804 


140.50 


.705 


.820 


.710 


.800 


141.50 


.716 


.813 


.710 


.791 


142.50 


.726 


.806 


.713 


.782 


143.50 


.740 


.797 


.720 


.778 


144.50 


.758 


.783 


.734 


.775 


145.50 


.779 


.771 


.752 


.764 
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p. 258 



Grade 7 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


146.50 


.796 


.761 


.755 


.747 


147.50 


.804 


.756 


.769 


.738 


148.50 


.807 


.751 


.776 


.734 


149.50 


.818 


.741 


.783 


.725 


150.50 


.828 


.729 


.815 


.713 


151.50 


.842 


.718 


.825 


.702 


152.50 


.860 


.700 


.839 


.687 


153.50 


.863 


.675 


.846 


.666 


154.50 


.867 


.660 


.853 


.653 


155.50 


.870 


.650 


.857 


.632 


156.50 


.874 


.639 


.867 


.621 


157.50 


.884 


.631 


.885 


.611 


158.50 


.891 


.614 


.888 


.598 


159.50 


.895 


.609 


.888 


.590 


160.50 


.905 


.601 


.892 


.585 


161.50 


.909 


.592 


.895 


.570 


162.50 


.912 


.576 


.899 


.562 


163.50 


.923 


.563 


.899 


.546 


164.50 


.933 


.557 


.902 


.537 


165.50 


.933 


.547 


.902 


.530 


166.50 


.940 


.540 


.902 


.526 


167.50 


.947 


.527 


.916 


.521 


168.50 


.947 


.514 


.916 


.508 


169.50 


.951 


.509 


.923 


.498 


170.50 


.951 


.498 


.927 


.484 


171.50 


.954 


.489 


.930 


.473 


172.50 


.958 


.483 


.937 


.465 


173.50 


.958 


.473 


.944 


.459 


174.50 


.958 


.468 


.951 


.456 


175.50 


.958 


.458 


.951 


.447 


176.50 


.958 


.450 


.951 


.443 


177.50 


.961 


.447 


.955 


.438 


178.50 


.965 


.441 


.955 


.437 


179.50 


.968 


.429 


.955 


.422 


180.50 


.968 


.420 


.955 


.411 


181.50 


.968 


.415 


.955 


.408 


182.50 


.968 


.413 


.958 


.403 
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p. 259 



Grade 7 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


183.50 


.968 


.406 


.962 


.399 


184.50 


.972 


.399 


.962 


.397 


185.50 


.972 


.388 


.962 


.391 


186.50 


.972 


.377 


.965 


.385 


187.50 


.975 


.368 


.969 


.376 


188.50 


.975 


.362 


.969 


.368 


189.50 


.975 


.343 


.972 


.356 


190.50 


.975 


.326 


.976 


.343 


191.50 


.975 


.315 


.976 


.331 


192.50 


.975 


.301 


.976 


.314 


193.50 


.975 


.291 


.976 


.307 


194.50 


.979 


.282 


.976 


.297 


195.50 


.979 


.277 


.983 


.288 


196.50 


.982 


.267 


.983 


.275 


197.50 


.982 


.258 


.983 


.268 


198.50 


.982 


.251 


.983 


.262 


199.50 


.982 


.240 


.983 


.244 


200.50 


.982 


.230 


.983 


.225 


201.50 


.982 


.227 


.983 


.223 


202.50 


.986 


.223 


.983 


.220 


203.50 


.986 


.220 


.990 


.211 


204.50 


.986 


.214 


.990 


.208 


205.50 


.986 


.206 


.990 


.200 


206.50 


.986 


.199 


.990 


.188 


207.50 


.989 


.192 


.990 


.177 


208.50 


.993 


.182 


.990 


.168 


209.50 


.993 


.175 


.990 


.167 


210.50 


.993 


.174 


.990 


.166 


211.50 


.993 


.169 


.990 


.157 


212.50 


.993 


.159 


.990 


.146 


213.50 


.993 


.144 


.993 


.135 


214.50 


.993 


.143 


.993 


.133 


215.50 


.993 


.133 


- 


- 


216.00 


- 


- 


.993 


.131 


216.50 


.993 


.125 


- 


- 


217.50 


.993 


.119 


.993 


.124 


218.50 


.996 


.113 


.993 


.118 
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Grade 7 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


219.50 


.996 


.110 


.993 


.114 


220.50 


.996 


.108 


.993 


.109 


221.50 


.996 


.105 


.993 


.104 


222.50 


.996 


.102 


- 


- 


223.00 


- 


- 


.993 


.103 


223.50 


.996 


.099 


- 


- 


224.50 


.996 


.095 


.993 


.101 


225.50 


.996 


.093 


.993 


.097 


226.50 


1.000 


.087 


- 


- 


227.00 


- 


- 


.993 


.086 


227.50 


1.000 


.084 


- 


- 


228.50 


1.000 


.074 


.993 


.079 


229.50 


1.000 


.066 


.993 


.071 


230.50 


1.000 


.064 


.993 


.067 


231.50 


1.000 


.061 


.993 


.055 


232.50 


1.000 


.060 


.993 


.053 


233.50 


1.000 


.058 


.993 


.043 


234.50 


1.000 


.053 


.993 


.041 


235.50 


- 


- 


.993 


.035 


236.50 


- 


- 


.993 


.033 


237.00 


1.000 


.047 


- 


- 


238.00 


- 


- 


.993 


.031 


239.50 


1.000 


.046 


.997 


.030 


240.50 


1.000 


.042 


.997 


.025 


241.50 


1.000 


.041 


.997 


.023 


242.50 


1.000 


.034 


- 


- 


243.00 


- 


- 


.997 


.020 


244.50 


1.000 


.032 


- 


- 


245.00 


- 


- 


.997 


.019 


246.50 


1.000 


.028 


.997 


.018 


247.50 


1.000 


.027 


- 


- 


248.00 


- 


- 


.997 


.016 


249.00 


1.000 


.025 


- 


- 


249.50 


- 


- 


.997 


.015 


250.50 


1.000 


.024 


.997 


.013 


251.50 


1.000 


.020 


.997 


.012 


252.50 


1.000 


.017 


- 


- 
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Grade 7 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


253.00 


- 


- 


.997 


.011 


253.50 


1.000 


.016 


- 


- 


254.50 


1.000 


.013 


.997 


.010 


255.50 


1.000 


.012 


1.000 


.010 


256.50 


1.000 


.011 


1.000 


.009 


258.50 


- 


- 


1.000 


.007 


260.00 


1.000 


.010 


- 


- 


263.50 


- 


- 


1.000 


.004 


264.00 


1.000 


.009 


- 


- 


267.50 


1.000 


.008 


- 


- 


269.50 


- 


- 


1.000 


.003 


272.00 


1.000 


.007 


- 


- 


273.00 


- 


- 


1.000 


.002 


275.50 


1.000 


.004 


- 


- 


278.50 


1.000 


.003 


- 


- 


282.50 


1.000 


.002 


- 


- 


285.50 


- 


- 


1.000 


.001 


288.50 


1.000 


.001 


- 


- 


293.00 


1.000 


.000 


- 


- 


298.00 


- 


- 


1.000 


.000 
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Grade 7 

Spring MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


290 




Negative 


1350 




Missing 


160 


Group 2 


Positive 3 


288 




Negative 


1322 




Missing 


190 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOMCRC has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOMCRC 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.816 


.014 


.000 


.790 .843 


Group 2 


.835 


.014 


.000 


SO 

OO 

OO 

O 

OO 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOMCRC has at least 
one tie between the positive actual state group and the negative actual state group. Statistics 
may be biased. 
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ROC Curve 



Crossvalitlation: Group 1 




ROC Curve 



Crossvalitlation: Group 2 




Diagonal segments are produced by ties. 
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Grade 7 

Spring MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.017 


1.000 


.024 


.999 


1.50 


.021 


1.000 


.028 


.998 


2.50 


.024 


1.000 


.035 


.998 


3.50 


.024 


.999 


.038 


.997 


4.50 


.031 


.998 


.052 


.996 


5.50 


.079 


.994 


.101 


.995 


6.50 


.148 


.991 


.163 


.989 


7.50 


.259 


.984 


.222 


.980 


8.50 


.338 


.966 


.347 


.964 


9.50 


.445 


.932 


.479 


.931 


10.50 


.548 


.860 


.635 


.863 


11.50 


.703 


.763 


.747 


.793 


12.50 


.831 


.647 


.854 


.654 


13.50 


.907 


.485 


.913 


.502 


14.50 


.966 


.303 


.955 


.305 


15.50 


.990 


.164 


.976 


.141 


16.50 


.993 


.065 


.993 


.064 


17.50 


1.000 


.017 


1.000 


.020 


18.50 


1.000 


.001 


1.000 


.005 


20.00 


1.000 


.000 


1.000 


.001 


21.00 


- 


- 


1.000 


.000 
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Grade 7 

Spring VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


133 




Negative 


780 




Missing 


887 


Group 2 


Positive 3 


135 




Negative 


754 




Missing 


911 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): SprlOVoc has at least one tie 
between the positive actual state group and the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s): SprlOVoc 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.826 


.018 


.000 


.791 .861 


Group 2 


.856 


.014 


.000 


.828 .884 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): SprlOVoc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): SprlOVoc has at least one 
tie between the positive actual state group and the negative actual state group. Statistics may be 
biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 7 

Spring VQC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.045 


.977 


.022 


.995 


2.50 


.045 


.976 


.022 


.991 


3.50 


- 


- 


.030 


.991 


4.50 


.053 


.974 


.044 


.989 


5.50 


.068 


.974 


.052 


.985 


6.50 


.083 


.974 


.089 


.984 


7.50 


.135 


.971 


.111 


.980 


8.50 


.203 


.962 


.178 


.971 


9.50 


.233 


.946 


.281 


.960 


10.50 


.376 


.921 


.370 


.934 


11.50 


.526 


.888 


.519 


.893 


12.50 


.654 


.836 


.637 


.841 


13.50 


.744 


.777 


.770 


.782 


14.50 


.820 


.715 


.889 


.711 


15.50 


.880 


.637 


.919 


.638 


16.50 


.910 


.536 


.956 


.544 


17.50 


.940 


.455 


.978 


.477 


18.50 


.962 


.373 


.993 


.397 


19.50 


.977 


.292 


1.000 


.316 


20.50 


.985 


.217 


1.000 


.241 


21.50 


.985 


.149 


1.000 


.164 


22.50 


1.000 


.085 


1.000 


.103 


23.50 


1.000 


.045 


1.000 


.041 


24.50 


1.000 


.017 


1.000 


.023 


26.00 


1.000 


.000 


1.000 


.000 
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Grade 8 

Fall PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


388 




Negative 


765 




Missing 


721 


Group 2 


Positive 3 


400 




Negative 


741 




Missing 


734 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): easyCBM Passage Reading 
Fluency Score Grade 8 Fall has at least one tie between the positive actual state group and the 
negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):easyCBM Passage Reading Fluency Score Grade 8 Fall 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.824 


.013 


.000 


.798 .850 


Group 2 


.843 


.012 


.000 


.820 .867 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): easyCBM Passage 
Reading Fluency Score Grade 8 Fall has at least one tie between the positive actual state group 
and the negative actual state group. Statistics may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): easyCBM Passage 
Reading Fluency Score Grade 8 Fall has at least one tie between the positive actual state group 
and the negative actual state group. Statistics may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 8 

Fall PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


7.00 


.000 


1.000 


- 


- 


15.00 


- 


- 


.000 


1.000 


17.50 


.003 


1.000 


- 


- 


19.50 


- 


- 


.002 


1.000 


28.00 


- 


- 


.005 


1.000 


32.50 


.008 


1.000 


- 


- 


34.50 


- 


- 


.010 


1.000 


39.50 


- 


- 


.013 


1.000 


43.00 


.013 


1.000 


- 


- 


43.50 


- 


- 


.015 


1.000 


46.00 


- 


- 


.018 


1.000 


48.50 


.015 


1.000 


.020 


1.000 


49.50 


- 


- 


.025 


1.000 


50.00 


.018 


1.000 


- 


- 


50.50 


- 


- 


.030 


1.000 


51.50 


- 


- 


.033 


1.000 


52.00 


.023 


1.000 


- 


- 


54.00 


.028 


1.000 


- 


- 


54.50 


- 


- 


.038 


1.000 


56.00 


.031 


1.000 


- 


- 


58.00 


- 


- 


.040 


1.000 


59.50 


.034 


1.000 


.045 


1.000 


61.50 


- 


- 


.048 


1.000 


62.50 


.036 


1.000 


- 


- 


63.50 


.039 


1.000 


.050 


1.000 


65.50 


.044 


1.000 


- 


- 


66.00 


- 


- 


.055 


1.000 


68.50 


.046 


.999 


- 


- 


69.00 


- 


- 


.058 


1.000 


71.00 


.052 


.999 


- 


- 


71.50 


- 


- 


.060 


1.000 


73.00 


.054 


.999 


- 


- 


74.00 


- 


- 


.063 


1.000 


74.50 


.057 


.999 


- 


- 


75.50 


.059 


.999 


.068 


1.000 


76.50 


.062 


.999 


.070 


1.000 


77.50 


.064 


.999 


- 


- 




Cross Validation: Oregon 



Appendix B 



p. 271 



Grade 8 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


78.50 


- 


- 


.073 


1.000 


79.50 


.070 


.999 


- 


- 


80.50 


- 


- 


.075 


.999 


81.50 


.072 


.999 


.080 


.997 


82.50 


.075 


.999 


.083 


.997 


83.50 


- 


- 


.085 


.997 


85.00 


.077 


.999 


.095 


.997 


86.50 


- 


- 


.103 


.997 


87.50 


.080 


.999 


.103 


.996 


89.00 


.082 


.999 


.108 


.996 


90.50 


- 


- 


.110 


.996 


91.00 


.082 


.997 


- 


- 


91.50 


- 


- 


.113 


.996 


92.50 


- 


- 


.115 


.996 


93.50 


.085 


.997 


.118 


.996 


95.00 


- 


- 


.123 


.996 


95.50 


.090 


.997 


- 


- 


96.50 


- 


- 


.125 


.996 


97.00 


.095 


.997 


- 


- 


97.50 


- 


- 


.133 


.996 


98.50 


.098 


.996 


- 


- 


99.00 


- 


- 


.135 


.995 


99.50 


.101 


.996 


- 


- 


100.50 


.106 


.996 


.140 


.995 


101.50 


.111 


.996 


.143 


.995 


102.50 


.121 


.996 


- 


- 


103.00 


- 


- 


.150 


.995 


104.00 


.126 


.996 


- 


- 


104.50 


- 


- 


.158 


.995 


105.50 


.134 


.996 


.165 


.995 


106.50 


.144 


.995 


.178 


.993 


107.50 


.155 


.995 


.188 


.993 


108.50 


.162 


.995 


.198 


.993 


109.50 


.170 


.995 


.208 


.993 


110.50 


.183 


.991 


.218 


.992 


111.50 


.188 


.991 


.228 


.992 


112.50 


.191 


.991 


.235 


.992 
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Grade 8 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


113.50 


.196 


.990 


.245 


.991 


114.50 


.206 


.988 


.250 


.989 


115.50 


.211 


.988 


.258 


.988 


116.50 


.214 


.988 


.265 


.987 


117.50 


.224 


.987 


.268 


.985 


118.50 


.235 


.984 


.275 


.984 


119.50 


.253 


.984 


.280 


.982 


120.50 


.268 


.978 


.290 


.980 


121.50 


.281 


.975 


.313 


.978 


122.50 


.302 


.971 


.330 


.974 


123.50 


.320 


.971 


.343 


.966 


124.50 


.335 


.970 


.358 


.960 


125.50 


.345 


.969 


.368 


.957 


126.50 


.353 


.963 


.373 


.957 


127.50 


.366 


.961 


.388 


.954 


128.50 


.369 


.959 


.395 


.951 


129.50 


.374 


.954 


.405 


.950 


130.50 


.384 


.954 


.423 


.950 


131.50 


.399 


.950 


.425 


.950 


132.50 


.407 


.946 


.445 


.945 


133.50 


.420 


.945 


.455 


.945 


134.50 


.441 


.942 


.458 


.939 


135.50 


.456 


.936 


.460 


.935 


136.50 


.472 


.928 


.478 


.933 


137.50 


.500 


.923 


.490 


.930 


138.50 


.518 


.916 


.500 


.924 


139.50 


.521 


.915 


.510 


.920 


140.50 


.523 


.910 


.528 


.919 


141.50 


.526 


.901 


.533 


.914 


142.50 


.531 


.897 


.540 


.911 


143.50 


.552 


.890 


.550 


.910 


144.50 


.564 


.884 


.565 


.906 


145.50 


.577 


.877 


.575 


.904 


146.50 


.593 


.875 


.590 


.895 


147.50 


.603 


.858 


.603 


.891 


148.50 


.613 


.856 


.615 


.887 


149.50 


.619 


.847 


.625 


.880 
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Grade 8 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


150.50 


.631 


.837 


.633 


.869 


151.50 


.657 


.829 


.643 


.856 


152.50 


.670 


.824 


.650 


.846 


153.50 


.683 


.817 


.655 


.838 


154.50 


.688 


.809 


.678 


.830 


155.50 


.704 


.803 


.685 


.822 


156.50 


.714 


.800 


.698 


.811 


157.50 


.727 


.787 


.708 


.803 


158.50 


.742 


.782 


.718 


.791 


159.50 


.750 


.769 


.723 


.776 


160.50 


.755 


.763 


.738 


.768 


161.50 


.765 


.757 


.753 


.756 


162.50 


.771 


.744 


.768 


.745 


163.50 


.778 


.731 


.798 


.733 


164.50 


.789 


.718 


.805 


.719 


165.50 


.796 


.706 


.813 


.703 


166.50 


.812 


.690 


.818 


.688 


167.50 


.817 


.675 


.825 


.676 


168.50 


.822 


.651 


.838 


.656 


169.50 


.825 


.639 


.840 


.652 


170.50 


.835 


.625 


.850 


.637 


171.50 


.840 


.620 


.853 


.632 


172.50 


.843 


.613 


.855 


.621 


173.50 


.845 


.607 


.868 


.599 


174.50 


.851 


.596 


.880 


.590 


175.50 


.863 


.586 


.885 


.574 


176.50 


.871 


.571 


.885 


.563 


177.50 


.874 


.557 


.893 


.551 


178.50 


.876 


.536 


.900 


.534 


179.50 


.876 


.525 


.903 


.529 


180.50 


.881 


.522 


.910 


.520 


181.50 


.884 


.515 


.915 


.514 


182.50 


.887 


.505 


.920 


.506 


183.50 


.889 


.492 


.928 


.499 


184.50 


.889 


.482 


.930 


.493 


185.50 


.889 


.476 


.933 


.487 


186.50 


.899 


.467 


.935 


.480 
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Grade 8 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


187.50 


.902 


.448 


.935 


.471 


188.50 


.905 


.444 


.935 


.463 


189.50 


.910 


.433 


.940 


.457 


190.50 


.912 


.429 


.945 


.447 


191.50 


.912 


.426 


.948 


.437 


192.50 


.918 


.420 


.950 


.422 


193.50 


.920 


.412 


.953 


.408 


194.50 


.925 


.395 


.958 


.394 


195.50 


.928 


.388 


.960 


.389 


196.50 


.928 


.383 


.965 


.382 


197.50 


.933 


.378 


.965 


.368 


198.50 


.936 


.373 


.965 


.355 


199.50 


.936 


.363 


.965 


.347 


200.50 


.938 


.352 


.968 


.341 


201.50 


.938 


.336 


.975 


.324 


202.50 


.941 


.325 


.978 


.317 


203.50 


.941 


.311 


.980 


.312 


204.50 


.943 


.298 


.983 


.305 


205.50 


.946 


.278 


.983 


.297 


206.50 


.948 


.272 


.983 


.294 


207.50 


.951 


.267 


.983 


.289 


208.50 


.951 


.261 


.983 


.279 


209.50 


.951 


.252 


.983 


.267 


210.50 


.954 


.246 


.983 


.265 


211.50 


.956 


.241 


.985 


.262 


212.50 


.956 


.233 


.985 


.259 


213.50 


.956 


.229 


.985 


.254 


214.50 


.961 


.216 


.985 


.244 


215.50 


.964 


.207 


.985 


.229 


216.50 


.972 


.193 


.990 


.209 


217.50 


.977 


.186 


.990 


.205 


218.50 


.985 


.174 


.990 


.192 


219.50 


.987 


.169 


.990 


.184 


220.50 


.990 


.163 


.990 


.182 


221.50 


.990 


.162 


.990 


.179 


222.50 


.990 


.153 


.990 


.167 


223.50 


.992 


.141 


.990 


.151 
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Grade 8 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


224.50 


.992 


.136 


.993 


.148 


225.50 


.992 


.131 


.993 


.139 


226.50 


.992 


.124 


.993 


.134 


227.50 


.992 


.118 


.993 


.128 


228.50 


.992 


.115 


.993 


.126 


229.50 


- 


- 


.993 


.124 


230.00 


.992 


.111 


- 


- 


230.50 


- 


- 


.993 


.123 


231.50 


.992 


.107 


.993 


.115 


232.50 


.992 


.101 


.995 


.107 


233.50 


.992 


.084 


.995 


.096 


234.50 


.992 


.081 


.995 


.094 


235.50 


.995 


.078 


.995 


.088 


236.50 


.995 


.075 


.995 


.081 


237.50 


- 


- 


.995 


.078 


238.50 


- 


- 


.998 


.078 


239.00 


.995 


.073 


- 


- 


239.50 


- 


- 


.998 


.074 


240.50 


- 


- 


.998 


.073 


241.50 


.995 


.071 


.998 


.070 


242.50 


.997 


.061 


.998 


.067 


243.50 


1.000 


.058 


.998 


.065 


245.00 


- 


- 


.998 


.059 


245.50 


1.000 


.054 


- 


- 


247.50 


1.000 


.048 


- 


- 


248.00 


- 


- 


.998 


.054 


248.50 


1.000 


.043 


- 


- 


249.50 


1.000 


.042 


- 


- 


251.00 


1.000 


.037 


.998 


.051 


252.00 


- 


- 


.998 


.047 


253.00 


1.000 


.035 


- 


- 


253.50 


- 


- 


.998 


.043 


254.50 


1.000 


.029 


.998 


.038 


255.50 


1.000 


.027 


.998 


.034 


256.50 


1.000 


.025 


- 


- 


257.00 


- 


- 


.998 


.030 


257.50 


1.000 


.024 


- 


- 
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p. 276 



Grade 8 

Fall PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


258.50 


- 


- 


.998 


.028 


259.00 


1.000 


.022 


- 


- 


529.50 


- 


- 


1.000 


.028 


260.50 


1.000 


.021 


1.000 


.027 


261.50 


- 


- 


1.000 


.024 


262.50 


1.000 


.018 


1.000 


.022 


263.50 


- 


- 


1.000 


.019 


265.00 


1.000 


.014 


- 


- 


265.50 


- 


- 


1.000 


.018 


266.50 


1.000 


.013 


- 


- 


267.50 


- 


- 


1.000 


.015 


268.00 


1.000 


.012 


- 


- 


268.50 


- 


- 


1.000 


.012 


269.50 


1.000 


.008 


- 


- 


270.50 


- 


- 


1.000 


.011 


271.00 


1.000 


.007 


- 


- 


273.00 


- 


- 


1.000 


.009 


274.00 


1.000 


.005 


- 


- 


276.00 


- 


- 


1.000 


.008 


277.00 


1.000 


.004 


- 


- 


278.50 


1.000 


.003 


- 


- 


280.00 


- 


- 


1.000 


.005 


282.50 


- 


- 


1.000 


.004 


286.00 


- 


- 


1.000 


.003 


298.50 


- 


- 


1.000 


.001 


309.00 


- 


- 


1.000 


.000 


338.00 


1.000 


.001 


- 


- 


398.00 


1.000 


.000 


- 


- 
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Grade 8 

Fall MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


478 




Negative 


1190 




Missing 


206 


Group 2 


Positive 3 


487 




Negative 


1185 




Missing 


203 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): easyCBM Multiple Choice Read 
Comp Score Grade 8 Fall has at least one tie between the positive actual state group and the 
negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):easyCBM Multiple Choice Read Comp Score Grade 8 Fall 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.812 






.789 .835 


Group 2 


.806 






.782 .829 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): easyCBM Multiple Choice 
Read Comp Score Grade 8 Fall has at least one tie between the positive actual state group and 
the negative actual state group. Statistics may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): easyCBM Multiple 
Choice Read Comp Score Grade 8 Fall has at least one tie between the positive actual state 
group and the negative actual state group. Statistics may be biased. 
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p. 278 



ROC Curve 



Crossvalitlation: Group 1 




ROC Curve 



Crossvalitlation: Group 2 




Diagonal segments are produced by ties. 
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Grade 8 

Fall MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.006 


1.000 


.010 


.999 


1.50 


.006 


.999 


.014 


.998 


2.50 


.013 


.998 


.016 


.998 


3.50 


.023 


.998 


.023 


.997 


4.50 


.031 


.998 


.041 


.997 


5.50 


.050 


.997 


.051 


.995 


6.50 


.075 


.994 


.086 


.994 


7.50 


.132 


.992 


.129 


.990 


8.50 


.199 


.987 


.187 


.984 


9.50 


.278 


.976 


.271 


.971 


10.50 


.349 


.951 


.388 


.944 


11.50 


.460 


.924 


.483 


.915 


12.50 


.594 


.861 


.583 


.862 


13.50 


.697 


.793 


.692 


.785 


14.50 


.801 


.658 


.811 


.657 


15.50 


.895 


.492 


.877 


.495 


16.50 


.946 


.298 


.936 


.311 


17.50 


.983 


.151 


.979 


.144 


18.50 


.998 


.038 


.996 


.046 


19.50 


1.000 


.003 


1.000 


.010 


21.00 


1.000 


.000 


1.000 


.000 
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Grade 8 

Fall VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


237 




Negative 


754 




Missing 


883 


Group 2 


Positive 3 


245 




Negative 


750 




Missing 


880 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): easyCBM Vocabulary Score 
Grade 8 Fall has at least one tie between the positive actual state group and the negative actual 
state group. 



Area Under the Curve c d 

Test Result Variable(s):easyCBM Vocabulary Score Grade 8 Fall 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.812 


.015 


.000 


.783 .841 


Group 2 


.831 


.014 


.000 


.803 .858 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): easyCBM Vocabulary 
Score Grade 8 Fall has at least one tie between the positive actual state group and the negative 
actual state group. Statistics may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): easyCBM Vocabulary 
Score Grade 8 Fall has at least one tie between the positive actual state group and the negative 
actual state group. Statistics may be biased. 
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ROC Curve 



Crossvalitlation: Group 1 




ROC Curve 



Crossvalitlation: Group 2 




Diagonal segments are produced by ties. 
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Grade 8 

Fall VOC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.000 


.997 


.008 


.996 


2.50 


.008 


.997 


.008 


.995 


4.50 


.017 


.996 


.020 


.995 


5.50 


.038 


.995 


.024 


.993 


6.50 


.059 


.993 


.049 


.993 


7.50 


.084 


.987 


.102 


.991 


8.50 


.160 


.979 


.171 


.984 


9.50 


.253 


.955 


.233 


.964 


10.50 


.346 


.934 


.347 


.936 


11.50 


.464 


.891 


.478 


.903 


12.50 


.624 


.842 


.633 


.855 


13.50 


.717 


.752 


.731 


.775 


14.50 


.785 


.679 


.812 


.692 


15.50 


.861 


.573 


.886 


.595 


16.50 


.924 


.467 


.922 


.497 


17.50 


.975 


.363 


.971 


.392 


18.50 


.983 


.265 


.984 


.296 


19.50 


.992 


.186 


.992 


.225 


20.50 


.996 


.119 


.996 


.157 


21.50 


1.000 


.065 


1.000 


.084 


22.50 


1.000 


.033 


1.000 


.041 


23.50 


1.000 


.012 


1.000 


.012 


24.50 


1.000 


.001 


1.000 


.003 


26.00 


1.000 


.000 


1.000 


.000 
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Grade 8 

Winter PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


387 




Negative 


769 




Missing 


718 


Group 2 


Positive 3 


402 




Negative 


754 




Missing 


719 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): easyCBM Passage Reading 
Fluency Score Grade 8 Winter has at least one tie between the positive actual state group and 
the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):easyCBM Passage Reading Fluency Score Grade 8 Winter 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.803 


.014 


.000 


.776 .830 


Group 2 


.836 


.012 


.000 


.812 .860 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): easyCBM Passage 
Reading Fluency Score Grade 8 Winter has at least one tie between the positive actual state 
group and the negative actual state group. Statistics may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): easyCBM Passage 
Reading Fluency Score Grade 8 Winter has at least one tie between the positive actual state 
group and the negative actual state group. Statistics may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 8 

Winter PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


9.00 


- 


- 


.000 


1.000 


10.00 


.000 


1.000 


- 


- 


14.00 


- 


- 


.002 


1.000 


16.00 


.003 


1.000 


- 


- 


20.00 


- 


- 


.005 


1.000 


25.50 


.005 


1.000 


.007 


1.000 


30.00 


- 


- 


.010 


1.000 


31.50 


- 


- 


.012 


1.000 


32.00 


.008 


1.000 


- 


- 


33.00 


- 


- 


.015 


1.000 


34.50 


.013 


1.000 


- 


- 


36.00 


- 


- 


.017 


1.000 


37.00 


.016 


1.000 


- 


- 


40.00 


- 


- 


.020 


1.000 


41.00 


.018 


1.000 


- 


- 


44.00 


- 


- 


.022 


1.000 


46.00 


.021 


1.000 


- 


- 


47.00 


- 


- 


.025 


1.000 


49.50 


- 


- 


.027 


1.000 


51.50 


- 


- 


.030 


1.000 


52.00 


.028 


1.000 


- 


- 


52.50 


- 


- 


.032 


1.000 


53.50 


- 


- 


.035 


1.000 


54.50 


- 


- 


.037 


1.000 


55.50 


.031 


1.000 


- 


- 


56.00 


- 


- 


.040 


1.000 


57.50 


.036 


1.000 


.042 


1.000 


58.50 


- 


- 


.047 


1.000 


60.00 


- 


- 


.052 


1.000 


61.00 


.041 


1.000 


- 


- 


61.50 


- 


- 


.055 


1.000 


62.50 


- 


- 


.062 


1.000 


63.50 


- 


- 


.070 


1.000 


64.00 


.044 


1.000 


- 


- 


64.50 


- 


- 


.075 


1.000 


65.50 


.049 


1.000 


.077 


1.000 


66.50 


.057 


1.000 


.092 


1.000 
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Grade 8 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


67.50 


.062 


1.000 


.100 


1.000 


69.00 


.065 


1.000 


.102 


1.000 


70.50 


.067 


1.000 


.109 


1.000 


71.50 


.070 


1.000 


.112 


1.000 


72.50 


.072 


1.000 


.119 


1.000 


73.50 


.075 


.997 


.124 


1.000 


74.50 


.085 


.997 


.129 


1.000 


75.50 


.088 


.997 


.134 


1.000 


76.50 


.093 


.997 


.139 


1.000 


77.50 


.096 


.996 


.142 


1.000 


78.50 


.098 


.996 


.144 


1.000 


79.50 


.101 


.995 


.147 


1.000 


80.50 


.103 


.995 


.149 


1.000 


81.50 


- 


- 


.157 


1.000 


82.00 


.106 


.995 


- 


- 


82.50 


- 


- 


.164 


1.000 


83.50 


.111 


.995 


.169 


1.000 


84.50 


.111 


.993 


.169 


.999 


86.00 


.114 


.993 


.172 


.999 


87.50 


.116 


.993 


.174 


.999 


89.00 


.129 


.993 


.182 


.997 


83.50 


- 


- 


.184 


.997 


90.50 


.132 


.993 


.184 


.996 


91.50 


.134 


.993 


.187 


.996 


92.50 


.140 


.993 


.197 


.996 


93.50 


.142 


.993 


- 


- 


94.00 


- 


- 


.199 


.996 


94.50 


.150 


.993 


- 


- 


95.50 


.152 


.993 


.204 


.993 


96.50 


.158 


.992 


.211 


.993 


97.50 


.160 


.990 


.214 


.993 


98.50 


.165 


.988 


.221 


.993 


99.50 


.173 


.986 


.229 


.992 


100.50 


.181 


.986 


.231 


.992 


101.50 


.189 


.982 


.236 


.991 


102.50 


.191 


.980 


- 


- 


103.00 


- 


- 


.239 


.989 
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Grade 8 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


103.50 


.199 


.979 


- 


- 


104.50 


.212 


.979 


.246 


.988 


105.50 


.220 


.979 


.251 


.985 


106.50 


.235 


.979 


.256 


.983 


107.50 


.240 


.978 


.274 


.981 


108.50 


.266 


.977 


.286 


.977 


109.50 


.279 


.973 


.291 


.973 


110.50 


.297 


.971 


.303 


.969 


111.50 


.305 


.970 


.311 


.964 


112.50 


.310 


.967 


.318 


.960 


113.50 


.323 


.965 


.338 


.959 


114.50 


.339 


.962 


.343 


.955 


115.50 


.346 


.956 


.361 


.950 


116.50 


.357 


.956 


.373 


.947 


117.50 


.370 


.951 


.383 


.946 


118.50 


.393 


.949 


.388 


.943 


119.50 


.408 


.947 


.403 


.940 


120.50 


.416 


.944 


.410 


.939 


121.50 


.426 


.938 


.415 


.936 


122.50 


.432 


.932 


.430 


.931 


123.50 


.447 


.925 


.458 


.923 


124.50 


.455 


.918 


.460 


.920 


125.50 


.473 


.908 


.488 


.916 


126.50 


.486 


.899 


.512 


.915 


127.50 


.496 


.889 


.527 


.907 


128.50 


.509 


.884 


.547 


.902 


129.50 


.519 


.878 


.550 


.898 


130.50 


.525 


.874 


.560 


.890 


131.50 


.537 


.865 


.567 


.883 


132.50 


.550 


.857 


.575 


.879 


133.50 


.563 


.853 


.585 


.877 


134.50 


.576 


.848 


.592 


.874 


135.50 


.594 


.839 


.604 


.866 


136.50 


.618 


.832 


.612 


.859 


137.50 


.636 


.821 


.632 


.847 


138.50 


.641 


.815 


.642 


.840 


139.50 


.646 


.809 


.647 


.834 
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Grade 8 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


140.50 


.649 


.805 


.654 


.830 


141.50 


.654 


.797 


.669 


.825 


142.50 


.661 


.795 


.677 


.817 


143.50 


.672 


.788 


.689 


.812 


144.50 


.680 


.782 


.699 


.809 


145.50 


.682 


.772 


.709 


.800 


146.50 


.695 


.769 


.724 


.785 


147.50 


.698 


.766 


.729 


.777 


148.50 


.708 


.762 


.741 


.773 


149.50 


.721 


.754 


.751 


.768 


150.50 


.729 


.749 


.751 


.760 


151.50 


.736 


.744 


.756 


.752 


152.50 


.749 


.731 


.766 


.741 


153.50 


.760 


.723 


.769 


.737 


154.50 


.762 


.717 


.774 


.728 


155.50 


.778 


.706 


.779 


.725 


156.50 


.783 


.685 


.786 


.718 


157.50 


.788 


.667 


.799 


.710 


158.50 


.788 


.659 


.801 


.704 


159.50 


.791 


.650 


.806 


.688 


160.50 


.793 


.646 


.806 


.678 


161.50 


.796 


.636 


.816 


.668 


162.50 


.801 


.628 


.816 


.663 


163.50 


.806 


.623 


.816 


.650 


164.50 


.814 


.618 


.828 


.635 


165.50 


.817 


.612 


.831 


.627 


166.50 


.824 


.603 


.841 


.619 


167.50 


.829 


.594 


.848 


.611 


168.50 


.837 


.584 


.853 


.601 


169.50 


.840 


.572 


.861 


.592 


170.50 


.842 


.557 


.873 


.588 


171.50 


.853 


.544 


.878 


.574 


172.50 


.855 


.527 


.893 


.568 


173.50 


.858 


.512 


.896 


.557 


174.50 


.860 


.502 


.903 


.546 


175.50 


.868 


.481 


.913 


.529 


176.50 


.879 


.469 


.935 


.511 
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Grade 8 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


177.50 


.881 


.456 


.935 


.505 


178.50 


.886 


.442 


.935 


.500 


179.50 


.886 


.432 


.940 


.485 


180.50 


.891 


.423 


.948 


.469 


181.50 


.894 


.414 


.950 


.464 


182.50 


.897 


.404 


.950 


.451 


183.50 


.902 


.399 


.958 


.440 


184.50 


.902 


.391 


.958 


.431 


185.50 


.915 


.388 


.960 


.415 


186.50 


.920 


.373 


.960 


.402 


187.50 


.925 


.368 


.960 


.391 


188.50 


.928 


.356 


.960 


.385 


189.50 


.933 


.345 


.963 


.370 


190.50 


.935 


.332 


.963 


.367 


191.50 


.938 


.317 


.970 


.355 


192.50 


.941 


.309 


.970 


.342 


193.50 


.943 


.296 


.970 


.322 


194.50 


.948 


.294 


.970 


.320 


195.50 


.951 


.282 


.973 


.308 


196.50 


.956 


.276 


.973 


.297 


197.50 


.956 


.269 


.973 


.289 


198.50 


.959 


.260 


.973 


.281 


199.50 


.961 


.251 


.975 


.271 


200.50 


.961 


.246 


.975 


.261 


201.50 


.961 


.237 


.975 


.259 


202.50 


.964 


.235 


.975 


.253 


203.50 


.964 


.231 


.975 


.249 


204.50 


.964 


.228 


.975 


.244 


205.50 


.964 


.225 


.978 


.236 


206.50 


.964 


.218 


.978 


.232 


207.50 


.964 


.213 


.978 


.228 


208.50 


.969 


.205 


.983 


.223 


209.50 


.972 


.198 


.983 


.212 


210.50 


.977 


.195 


.983 


.196 


211.50 


.979 


.185 


.983 


.179 


212.50 


.979 


.168 


.988 


.155 


213.50 


.979 


.160 


- 


- 


214.00 


- 


- 


.988 


.153 
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Grade 8 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


214.50 


.979 


.152 


- 


- 


215.50 


.979 


.150 


.990 


.149 


216.50 


.982 


.146 


.990 


.139 


217.50 


.990 


.137 


.990 


.137 


218.50 


.992 


.125 


.990 


.135 


219.50 


.995 


.124 


.990 


.133 


220.50 


.995 


.117 


.990 


.129 


221.50 


.995 


.114 


.990 


.122 


222.50 


.995 


.111 


.993 


.115 


223.50 


.995 


.109 


.995 


.110 


224.50 


.995 


.105 


.995 


.106 


225.50 


.995 


.100 


- 


- 


226.00 


- 


- 


.998 


.103 


226.50 


.995 


.094 


- 


- 


227.50 


.995 


.087 


1.000 


.094 


228.50 


.995 


.086 


1.000 


.092 


229.50 


.995 


.082 


1.000 


.086 


230.50 


.995 


.078 


1.000 


.082 


231.50 


.995 


.074 


1.000 


.081 


232.50 


.995 


.072 


- 


- 


233.00 


- 


- 


1.000 


.080 


233.50 


.995 


.069 


- 


- 


234.50 


.995 


.064 


1.000 


.078 


235.50 


.995 


.061 


1.000 


.077 


236.50 


.995 


.060 


1.000 


.076 


237.50 


.995 


.056 


1.000 


.074 


238.50 


.995 


.044 


1.000 


.064 


239.50 


.997 


.044 


1.000 


.058 


240.50 


1.000 


.043 


1.000 


.053 


242.00 


1.000 


.040 


1.000 


.052 


244.00 


1.000 


.039 


1.000 


.045 


245.50 


1.000 


.034 


1.000 


.040 


247.50 


1.000 


.031 


1.000 


.038 


249.50 


1.000 


.030 


1.000 


.037 


250.50 


1.000 


.026 


- 


- 


251.00 


- 


- 


1.000 


.034 


252.50 


1.000 


.023 


- 


- 
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Grade 8 

Winter PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


253.00 


- 


- 


1.000 


.033 


254.50 


1.000 


.021 


1.000 


.032 


256.00 


1.000 


.017 


- 


- 


256.50 


- 


- 


1.000 


.029 


257.50 


1.000 


.016 


- 


- 


258.50 


1.000 


.014 


1.000 


.028 


259.50 


- 


- 


1.000 


.027 


260.50 


- 


- 


1.000 


.024 


261.00 


1.000 


.013 


- 


- 


261.50 


- 


- 


1.000 


.021 


262.50 


- 


- 


1.000 


.019 


263.50 


1.000 


.012 


- 


- 


264.00 


- 


- 


1.000 


.017 


265.00 


1.000 


.010 


- 


- 


266.00 


- 


- 


1.000 


.015 


267.00 


1.000 


.007 


- 


- 


269.50 


- 


- 


1.000 


.012 


272.50 


- 


- 


1.000 


.011 


274.00 


1.000 


.005 


- 


- 


277.00 


- 


- 


1.000 


.009 


287.50 


- 


- 


1.000 


.007 


290.50 


1.000 


.004 


- 


- 


294.50 


- 


- 


1.000 


.005 


298.50 


- 


- 


1.000 


.003 


302.00 


1.000 


.003 


- 


- 


302.50 


- 


- 


1.000 


.001 


304.00 


- 


- 


1.000 


.000 


323.00 


1.000 


.001 


- 


- 


344.00 


1.000 


.000 


- 


- 
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Grade 8 

Winter MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


356 




Negative 


718 




Missing 


800 


Group 2 


Positive 3 


362 




Negative 


669 




Missing 


844 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): easyCBM Multiple Choice Read 
Comp Score Grade 8 Winter has at least one tie between the positive actual state group and the 
negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):easyCBM Multiple Choice Read Comp Score Grade 8 Winter 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


Sig. b 


Lower Bound Upper Bound 


Group 1 




.014 


.000 


.775 .831 


Group 2 


.819 


.014 


.000 


.792 .846 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): easyCBM Multiple Choice 
Read Comp Score Grade 8 Winter has at least one tie between the positive actual state group 
and the negative actual state group. Statistics may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): easyCBM Multiple 
Choice Read Comp Score Grade 8 Winter has at least one tie between the positive actual state 
group and the negative actual state group. Statistics may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 





Cross Validation: Oregon 



Appendix B 



p. 294 



Grade 8 

Winter MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


.003 


1.000 


.006 


.999 


2.00 


.006 


1.000 


.006 


.997 


3.50 


.020 


1.000 


.008 


.997 


4.50 


.034 


.999 


.025 


.997 


5.50 


.073 


.999 


.066 


.997 


6.50 


.118 


.999 


.110 


.996 


7.50 


.183 


.990 


.196 


.994 


8.50 


.230 


.979 


.276 


.982 


9.50 


.326 


.955 


.381 


.954 


10.50 


.449 


.925 


.478 


.913 


11.50 


.584 


.861 


.605 


.843 


12.50 


.711 


.759 


.751 


.759 


13.50 


.820 


.589 


.859 


.584 


14.50 


.910 


.422 


.931 


.416 


15.50 


.961 


.255 


.967 


.221 


16.50 


.989 


.109 


.986 


.118 


17.50 


1.000 


.043 


.994 


.037 


18.50 


1.000 


.007 


1.000 


.012 


20.00 


1.000 


.000 


1.000 


.000 
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Grade 8 

Spring PRF Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


408 




Negative 


787 




Missing 


679 


Group 2 


Positive 3 


425 




Negative 


761 




Missing 


689 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): easyCBM Passage Reading 
Fluency Score Grade 8 Spring has at least one tie between the positive actual state group and 
the negative actual state group. 



Area Under the Curve c d 

Test Result Variable(s):easyCBM Passage Reading Fluency Score Grade 8 Spring 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.809 




.000 


.783 .835 


Group 2 


.844 




.000 


.822 .867 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): easyCBM Passage 
Reading Fluency Score Grade 8 Spring has at least one tie between the positive actual state 
group and the negative actual state group. Statistics may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): easyCBM Passage 
Reading Fluency Score Grade 8 Spring has at least one tie between the positive actual state 
group and the negative actual state group. Statistics may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Gronp 2 




Diagonal segments are produced by ties. 
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Grade 8 

Spring PRF Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


14.00 


.000 


1.000 


- 


- 


17.00 


.002 


1.000 


- 


- 


21.00 


- 


- 


.000 


1.000 


22.50 


.005 


1.000 


- 


- 


25.00 


- 


- 


.002 


1.000 


30.50 


- 


- 


.005 


1.000 


31.50 


.007 


1.000 


- 


- 


35.50 


- 


- 


.007 


1.000 


40.00 


.010 


1.000 


- 


- 


41.50 


- 


- 


.009 


1.000 


48.00 


.012 


1.000 


.012 


1.000 


53.50 


.015 


1.000 


- 


- 


54.00 


- 


- 


.014 


1.000 


54.50 


.017 


1.000 


- 


- 


57.00 


.020 


1.000 


- 


- 


57.50 


- 


- 


.016 


1.000 


59.00 


- 


- 


.019 


1.000 


60.50 


.025 


1.000 


- 


- 


61.00 


- 


- 


.021 


1.000 


62.50 


.027 


1.000 


.026 


1.000 


63.50 


.029 


1.000 


.028 


1.000 


64.50 


- 


- 


.031 


1.000 


65.50 


- 


- 


.035 


1.000 


66.00 


.032 


1.000 


- 


- 


67.50 


- 


- 


.040 


1.000 


69.50 


- 


- 


.042 


1.000 


70.50 


.034 


1.000 


.045 


1.000 


71.50 


- 


- 


.047 


.999 


72.50 


- 


- 


.049 


.999 


73.50 


- 


- 


.052 


.999 


74.00 


.037 


1.000 


- 


- 


74.50 


- 


- 


.056 


.999 


75.50 


.039 


1.000 


.061 


.999 


77.00 


- 


- 


.066 


.999 


77.50 


.042 


1.000 


- 


- 


78.50 


- 


- 


.071 


.999 


79.50 


.044 


1.000 


.073 


.999 
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Grade 8 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


80.50 


.047 


1.000 


.078 


.999 


81.50 


.051 


1.000 


- 


- 


82.50 


.054 


1.000 


.085 


.999 


83.50 


.061 


1.000 


- 


- 


84.50 


.066 


1.000 


.087 


.999 


85.50 


.071 


1.000 


.094 


.999 


86.50 


.074 


1.000 


.099 


.999 


87.50 


.076 


1.000 


.104 


.999 


88.50 


.081 


1.000 


.113 


.999 


89.50 


.083 


1.000 


.122 


.999 


90.50 


.086 


1.000 


.134 


.999 


91.50 


.091 


1.000 


.141 


.999 


92.50 


.100 


1.000 


.146 


.999 


93.50 


.103 


.996 


.153 


.997 


94.50 


.108 


.996 


.158 


.996 


95.50 


.110 


.995 


.172 


.996 


96.50 


.115 


.994 


.179 


.995 


97.50 


.125 


.994 


.184 


.995 


98.50 


.137 


.992 


.184 


.993 


99.50 


.145 


.991 


.188 


.992 


100.50 


.147 


.991 


.195 


.989 


101.50 


.159 


.991 


.205 


.989 


102.50 


.169 


.987 


.214 


.987 


103.50 


.179 


.987 


.219 


.987 


104.50 


.189 


.985 


.231 


.986 


105.50 


.199 


.982 


.240 


.986 


106.50 


.206 


.982 


.247 


.984 


107.50 


.211 


.981 


.254 


.982 


108.50 


.216 


.980 


.271 


.980 


109.50 


.223 


.978 


.273 


.980 


110.50 


.233 


.978 


.280 


.979 


111.50 


.238 


.976 


.294 


.978 


112.50 


.248 


.975 


.304 


.974 


113.50 


.257 


.975 


.322 


.974 


114.50 


.272 


.973 


.322 


.972 


115.50 


.282 


.971 


.336 


.972 


116.50 


.297 


.971 


.344 


.972 
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Grade 8 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


117.50 


.309 


.970 


.355 


.970 


118.50 


.314 


.970 


.365 


.968 


119.50 


.326 


.970 


.372 


.966 


120.50 


.338 


.970 


.381 


.963 


121.50 


.353 


.963 


.391 


.957 


122.50 


.360 


.957 


.391 


.954 


123.50 


.375 


.954 


.398 


.950 


124.50 


.385 


.950 


.416 


.946 


125.50 


.397 


.942 


.442 


.938 


126.50 


.426 


.933 


.459 


.933 


127.50 


.449 


.926 


.475 


.926 


128.50 


.468 


.914 


.501 


.920 


129.50 


.480 


.902 


.534 


.909 


130.50 


.488 


.900 


.555 


.904 


131.50 


.498 


.892 


.565 


.901 


132.50 


.505 


.887 


.579 


.895 


133.50 


.529 


.877 


.605 


.894 


134.50 


.542 


.870 


.605 


.890 


135.50 


.554 


.865 


.614 


.884 


136.50 


.564 


.861 


.614 


.880 


137.50 


.576 


.860 


.616 


.873 


138.50 


.581 


.853 


.624 


.867 


139.50 


.591 


.845 


.628 


.858 


140.50 


.600 


.836 


.640 


.854 


141.50 


.608 


.828 


.645 


.852 


142.50 


.610 


.818 


.659 


.846 


143.50 


.618 


.812 


.666 


.841 


144.50 


.632 


.807 


.673 


.836 


145.50 


.652 


.803 


.682 


.829 


146.50 


.667 


.797 


.692 


.821 


147.50 


.681 


.792 


.704 


.815 


148.50 


.686 


.785 


.715 


.803 


149.50 


.689 


.784 


.715 


.800 


150.50 


.701 


.780 


.727 


.792 


151.50 


.706 


.770 


.734 


.788 


152.50 


.716 


.762 


.746 


.778 


153.50 


.725 


.756 


.746 


.773 
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Grade 8 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


154.50 


.730 


.750 


.751 


.762 


155.50 


.745 


.742 


.760 


.756 


156.50 


.760 


.733 


.762 


.749 


157.50 


.765 


.719 


.776 


.733 


158.50 


.775 


.713 


.786 


.724 


159.50 


.777 


.705 


.793 


.708 


160.50 


.784 


.691 


.814 


.698 


161.50 


.792 


.676 


.821 


.690 


162.50 


.797 


.667 


.833 


.677 


163.50 


.801 


.656 


.849 


.662 


164.50 


.809 


.639 


.852 


.654 


165.50 


.814 


.634 


.852 


.647 


166.50 


.816 


.625 


.856 


.636 


167.50 


.816 


.611 


.859 


.632 


168.50 


.828 


.598 


.866 


.625 


169.50 


.841 


.587 


.873 


.616 


170.50 


.848 


.569 


.882 


.595 


171.50 


.850 


.550 


.892 


.576 


172.50 


.858 


.540 


.901 


.570 


173.50 


.865 


.529 


.908 


.552 


174.50 


.870 


.511 


.911 


.535 


175.50 


.882 


.490 


.920 


.522 


176.50 


.900 


.466 


.925 


.495 


177.50 


.907 


.447 


.927 


.470 


178.50 


.914 


.436 


.927 


.455 


179.50 


.919 


.422 


.932 


.445 


180.50 


.922 


.419 


.941 


.438 


181.50 


.926 


.410 


.944 


.419 


182.50 


.929 


.399 


.948 


.403 


183.50 


.929 


.388 


.953 


.393 


184.50 


.929 


.379 


.960 


.386 


185.50 


.929 


.362 


.960 


.377 


186.50 


.929 


.349 


.962 


.363 


187.50 


.931 


.337 


.967 


.353 


188.50 


.934 


.330 


.969 


.350 


189.50 


.936 


.325 


.972 


.343 


190.50 


.939 


.306 


.972 


.338 
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Grade 8 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 






Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


191.50 


.949 


.295 


.976 


.330 


192.50 


.949 


.287 


.976 


.325 


193.50 


.951 


.278 


.979 


.321 


194.50 


.953 


.271 


.984 


.315 


195.50 


.953 


.269 


.986 


.306 


196.50 


.953 


.259 


.986 


.294 


197.50 


.953 


.249 


.988 


.285 


198.50 


.956 


.239 


.988 


.276 


199.50 


.956 


.229 


.988 


.258 


200.50 


.963 


.216 


.988 


.240 


201.50 


.966 


.207 


.988 


.235 


202.50 


.966 


.205 


.988 


.229 


203.50 


.971 


.199 


.988 


.223 


204.50 


.973 


.197 


.988 


.218 


205.50 


.978 


.193 


.988 


.216 


206.50 


.978 


.187 


.988 


.214 


207.50 


.978 


.182 


.988 


.213 


208.50 


.978 


.178 


.993 


.204 


209.50 


.980 


.175 


.993 


.197 


210.50 


.983 


.172 


.993 


.192 


211.50 


.985 


.169 


.993 


.187 


212.50 


.988 


.154 


.993 


.175 


213.50 


.988 


.142 


.993 


.166 


214.50 


.988 


.131 


.993 


.158 


215.50 


.990 


.126 


.993 


.145 


216.50 


.990 


.114 


.993 


.139 


217.50 


.990 


.109 


.993 


.133 


218.50 


.990 


.107 


.995 


.125 


219.50 


.993 


.104 


.995 


.117 


220.50 


.993 


.100 


.995 


.112 


221.50 


.993 


.095 


.998 


.108 


222.50 


.995 


.091 


.998 


.105 


223.50 


- 


- 


.998 


.102 


224.00 


.995 


.090 


- 


- 


224.50 


- 


- 


.998 


.100 


225.50 


.998 


.089 


.998 


.096 


226.50 


1.000 


.084 


1.000 


.093 
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Grade 8 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


227.50 


1.000 


.079 


1.000 


.092 


228.50 


1.000 


.075 


1.000 


.089 


229.50 


1.000 


.071 


1.000 


.085 


230.50 


1.000 


.061 


1.000 


.080 


231.50 


1.000 


.058 


1.000 


.079 


232.50 


1.000 


.055 


1.000 


.064 


233.50 


1.000 


.048 


1.000 


.062 


234.50 


1.000 


.047 


1.000 


.059 


235.50 


1.000 


.043 


1.000 


.055 


236.50 


1.000 


.038 


1.000 


.053 


237.50 


1.000 


.036 


1.000 


.050 


238.50 


1.000 


.034 


1.000 


.049 


239.50 


1.000 


.033 


1.000 


.045 


240.50 


- 


- 


1.000 


.042 


241.00 


1.000 


.028 


- 


- 


241.50 


- 


- 


1.000 


.041 


242.50 


- 


- 


1.000 


.039 


243.50 


1.000 


.024 


1.000 


.038 


244.50 


- 


- 


1.000 


.034 


245.50 


1.000 


.022 


1.000 


.033 


246.50 


- 


- 


1.000 


.032 


247.00 


1.000 


.019 


- 


- 


247.50 


- 


- 


1.000 


.028 


248.50 


1.000 


.017 


- 


- 


249.50 


- 


- 


1.000 


.026 


250.00 


1.000 


.015 


- 


- 


251.50 


1.000 


.014 


1.000 


.024 


252.50 


- 


- 


1.000 


.021 


253.50 


1.000 


.011 


1.000 


.020 


254.50 


- 


- 


1.000 


.017 


256.50 


1.000 


.010 


- 


- 


258.00 


- 


- 


1.000 


.016 


260.00 


1.000 


.009 


- 


- 


262.00 


- 


- 


1.000 


.014 


262.50 


1.000 


.008 


- 


- 


263.50 


- 


- 


1.000 


.013 


265.00 


1.000 


.006 


- 


- 
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Grade 8 

Spring PRF Benchmark Cont. 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


269.50 


- 


- 


1.000 


.012 


270.50 


1.000 


.005 


- 


- 


276.00 


1.000 


.004 


- 


- 


276.50 


- 


- 


1.000 


.011 


278.50 


- 


- 


1.000 


.009 


284.00 


- 


- 


1.000 


.008 


290.50 


1.000 


.003 


- 


- 


291.00 


- 


- 


1.000 


.007 


298.00 


- 


- 


1.000 


.005 


303.50 


1.000 


.001 


1.000 


.004 


305.00 


1.000 


.000 


1.000 


.000 
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Grade 8 

Spring MCRC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


487 




Negative 


1189 




Missing 


198 


Group 2 


Positive 3 


491 




Negative 


1185 




Missing 


199 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): easyCBM Multiple Choice 
Reading Comprehension Score Grade 8 Spring has at least one tie between the positive actual 
state group and the negative actual state group. 



Area Under the Curve c d 



Test Result Variable(s):easyCBM Multiple Choice Reading Comprehension Score Grade 8 
Spring 











Asymptotic 95% Confidence 








Asymptotic 


Interval 


Crossvalidation 


Area 


Std. Error 3 


Sig. b 


Lower Bound Upper Bound 


Group 1 


.818 




.000 


.796 .841 


Group 2 


.837 




.000 


.816 .858 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): easyCBM Multiple Choice 
Reading Comprehension Score Grade 8 Spring has at least one tie between the positive actual 
state group and the negative actual state group. Statistics may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): easyCBM Multiple 
Choice Reading Comprehension Score Grade 8 Spring has at least one tie between the positive 
actual state group and the negative actual state group. Statistics may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 8 

Spring MCRC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


- 


- 


.010 


1.000 


1.00 


.010 


1.000 


- 


- 


1.50 


- 


- 


.014 


1.000 


2.50 


.014 


.999 


.018 


.998 


3.50 


.021 


.998 


.020 


.998 


4.50 


.039 


.998 


.041 


.996 


5.50 


.076 


.995 


.079 


.995 


6.50 


.138 


.992 


.128 


.986 


7.50 


.207 


.986 


.212 


.980 


8.50 


.281 


.971 


.330 


.966 


9.50 


.372 


.963 


.418 


.949 


10.50 


.480 


.927 


.517 


.919 


11.50 


.569 


.886 


.623 


.873 


12.50 


.676 


.810 


.741 


.787 


13.50 


.793 


.691 


.839 


.685 


14.50 


.891 


.514 


.900 


.539 


15.50 


.945 


.304 


.953 


.352 


16.50 


.982 


.158 


.988 


.161 


17.50 


.996 


.060 


.994 


.059 


18.50 


1.000 


.012 


1.000 


.012 


19.50 


1.000 


.001 


- 


- 


20.00 


- 


- 


1.000 


.000 


21.00 


1.000 


.000 


- 


- 
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Grade 8 

Spring VOC Benchmark 



Case Processing Summary 13 



Crossvalidation 


OAKS_Perf 


Valid N (listwise) 


Group 1 


Positive 3 


250 




Negative 


745 




Missing 


879 


Group 2 


Positive 3 


247 




Negative 


742 




Missing 


886 



Smaller values of the test result variable(s) indicate stronger evidence for a positive actual state. 

a. The positive actual state is .00. 

b. For split file Crossvalidation = Group 2, the test variable(s): easyCBM Vocabulary Score 
Grade 8 Spring has at least one tie between the positive actual state group and the negative 
actual state group. 



Area Under the Curve c d 

Test Result Variable(s):easyCBM Vocabulary Score Grade 8 Spring 











Asymptotic 95% Confidence 








Asymptotic . 


Interval 


Crossvalidation 


Area 


Std. Error 3 


sis. b 


Lower Bound Upper Bound 


Group 1 


.798 


.016 




.768 .829 


Group 2 


.810 


.015 




.781 .839 



a. Under the nonparametric assumption 

b. Null hypothesis: true area = 0.5 

c. For split file Crossvalidation = Group 1, the test result variable(s): easyCBM Vocabulary 
Score Grade 8 Spring has at least one tie between the positive actual state group and the 
negative actual state group. Statistics may be biased. 

d. For split file Crossvalidation = Group 2, the test result variable(s): easyCBM Vocabulary 
Score Grade 8 Spring has at least one tie between the positive actual state group and the 
negative actual state group. Statistics may be biased. 
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ROC Curve 



Crossvalidation: Group 1 




ROC Curve 



Crossvalidation: Group 2 




Diagonal segments are produced by ties. 
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Grade 8 

Spring VQC Benchmark 



Cut score 


Group 1 


Group 2 


Sensitivity 


Specificity 


Sensitivity 


Specificity 


-1.00 


.000 


1.000 


.000 


1.000 


.50 


- 


- 


.024 


.995 


1.00 


.020 


.995 


- 


- 


1.50 


- 


- 


.024 


.993 


3.00 


.024 


.995 


.028 


.992 


4.50 


.032 


.993 


.032 


.992 


5.50 


.036 


.993 


.036 


.992 


6.50 


.056 


.992 


.040 


.991 


7.50 


.084 


.991 


.077 


.991 


8.50 


.120 


.983 


.105 


.984 


9.50 


.200 


.977 


.174 


.970 


10.50 


.288 


.957 


.263 


.951 


11.50 


.380 


.930 


.364 


.927 


12.50 


.472 


.890 


.490 


.896 


13.50 


.576 


.827 


.563 


.836 


14.50 


.660 


.768 


.652 


.761 


15.50 


.748 


.691 


.781 


.694 


16.50 


.828 


.615 


.850 


.619 


17.50 


.884 


.506 


.911 


.539 


18.50 


.924 


.420 


.951 


.443 


19.50 


.964 


.325 


.972 


.348 


20.50 


.980 


.242 


.988 


.271 


21.50 


.992 


.184 


.992 


.181 


22.50 


.996 


.090 


.992 


.104 


23.50 


.996 


.042 


.996 


.046 


24.50 


1.000 


.007 


.996 


.011 


26.00 


1.000 


.000 


1.000 


.000 




